ELEKS Logo

ELEKS

Lead Data Engineer (Databricks/Python) in UK #TSCM-40888

Reposted 10 Hours Ago
Be an Early Applicant
United Kingdom
Senior level
United Kingdom
Senior level
Lead the design and delivery of robust ETL/ELT pipelines, drive technical leadership in data engineering, and collaborate with cross-functional teams in AWS and Databricks environments.
The summary above was generated by AI
ELEKS Software Engineering and Development Office is looking for a Lead Data Engineer in the United Kingdom.

ABOUT PROJECT
The customer is a British company producing electricity with zero carbon emissions.

REQUIREMENTS

  • 7+ years of experience in Data Engineering, including SQL and ETL (data validation, data mapping, exception handling)
  • 2+ years of hands-on experience with Databricks
  • 2+ years in a technical leadership role
  • Strong knowledge of Python
  • Practical experience with AWS services (e.g. S3, Redshift, Athena, Glue, Lambda)
  • Upper-Intermediate or higher level of English
  • Experience in energy-related domains (e.g. energy trading, utilities, power systems) — a strong advantage
  • Experience with geospatial data will be a plus
  • Ability to work on a dynamic, high-impact project in the energy sector
  • Comfortable collaborating with multinational teams and cross-functional stakeholders
  • Experience working in complex enterprise environments (defined processes, policies, and security protocols)
  • Strong interpersonal and clear, confident communication skills

RESPONSIBILITIES

  • Lead design and delivery of robust ETL/ELT pipelines with a focus on data quality and resilience
  • Drive technical leadership across the data engineering stream: architecture, coding standards, and mentoring
  • Collaborate with analysts, stakeholders, and cross-functional teams to align data solutions with business needs
  • Build and optimize data infrastructure in AWS (S3, Redshift, Glue, Lambda, etc.)
  • Use Databricks + Python to transform and orchestrate data workflows
  • Ensure compliance with enterprise security, governance, and SDLC best practices
  • Communicate proactively and clearly across teams and stakeholders in a fast-moving, international environment

WHAT WILL YOU GET WITH ELEKS

  • Close cooperation with a customer 
  • Challenging tasks 
  • Competence development 
  • Team of professionals 
  • Dynamic environment with a low level of bureaucracy

Top Skills

Athena
Aws (S3
Databricks
Glue
Lambda)
Python
Redshift
SQL

Similar Jobs

2 Days Ago
In-Office
3 Locations
Junior
Junior
Insurance
The Data Engineer will develop Python applications, maintain data integrity, design RESTful APIs, and collaborate on data solutions within an R&D team.
Top Skills: Ai/Ml ArchitectureCi/CdDatabricksPysparkPythonRestful Apis
An Hour Ago
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
As a Staff Product Manager, you will define products, drive payment capabilities for platforms, and work across teams to implement solutions.
Top Skills: Embedded FinancePayments Acquiring
3 Hours Ago
Remote or Hybrid
Staines, Surrey, England, GBR
Entry level
Entry level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Sales Development Representative will qualify leads and identify sales opportunities, while managing inbound leads and supporting marketing campaigns.
Top Skills: AICloud ComputingSaaS

What you need to know about the Belfast Tech Scene

If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account