ELEKS Logo

ELEKS

Lead Data Engineer (Databricks/Python) in UK #TSCM-40888

Posted 4 Days Ago
Be an Early Applicant
United Kingdom
Senior level
United Kingdom
Senior level
Lead the design and delivery of ETL/ELT pipelines, focusing on data quality, and drive technical leadership in data engineering. Collaborate with teams to align data solutions with business needs and oversee the optimization of AWS data infrastructure.
The summary above was generated by AI
ELEKS Software Engineering and Development Office is looking for a Lead Data Engineer in the United Kingdom.

ABOUT PROJECT
The customer is a British company producing electricity with zero carbon emissions.

REQUIREMENTS

  • 7+ years of experience in Data Engineering, including SQL and ETL (data validation, data mapping, exception handling)
  • 2+ years of hands-on experience with Databricks
  • 2+ years in a technical leadership role
  • Strong knowledge of Python
  • Practical experience with AWS services (e.g. S3, Redshift, Athena, Glue, Lambda)
  • Upper-Intermediate or higher level of English
  • Experience in energy-related domains (e.g. energy trading, utilities, power systems) — a strong advantage
  • Experience with geospatial data will be a plus
  • Ability to work on a dynamic, high-impact project in the energy sector
  • Comfortable collaborating with multinational teams and cross-functional stakeholders
  • Experience working in complex enterprise environments (defined processes, policies, and security protocols)
  • Strong interpersonal and clear, confident communication skills

RESPONSIBILITIES

  • Lead design and delivery of robust ETL/ELT pipelines with a focus on data quality and resilience
  • Drive technical leadership across the data engineering stream: architecture, coding standards, and mentoring
  • Collaborate with analysts, stakeholders, and cross-functional teams to align data solutions with business needs
  • Build and optimize data infrastructure in AWS (S3, Redshift, Glue, Lambda, etc.)
  • Use Databricks + Python to transform and orchestrate data workflows
  • Ensure compliance with enterprise security, governance, and SDLC best practices
  • Communicate proactively and clearly across teams and stakeholders in a fast-moving, international environment

WHAT WILL YOU GET WITH ELEKS

  • Close cooperation with a customer 
  • Challenging tasks 
  • Competence development 
  • Team of professionals 
  • Dynamic environment with a low level of bureaucracy

Top Skills

Athena
AWS
Databricks
ETL
Glue
Lambda
Python
Redshift
S3
SQL

Similar Jobs

6 Days Ago
In-Office
3 Locations
Mid level
Mid level
Insurance
As a Data Engineer, you will develop Python applications using Databricks and PySpark, collaborate with teams for data solutions, and maintain automated CI/CD pipelines.
Top Skills: Ci/CdDatabricksPysparkPythonRestful Apis
2 Hours Ago
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
As Staff Product Manager, lead product strategy, roadmap, and delivery for payments for platforms, enhancing solutions for marketplaces and compliance.
Top Skills: Embedded FinancePayments Acquiring
2 Hours Ago
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
As a Senior Software Engineer, you will develop stablecoin infrastructure, including transaction systems and blockchain integration while collaborating with multiple teams.
Top Skills: BlockchainC#C++Financial InfrastructureFxJavaKotlinPythonRust

What you need to know about the Belfast Tech Scene

If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account