ELEKS Logo

ELEKS

Lead Data Engineer (Databricks/Python) in UK #TSCM-40888

Reposted 21 Days Ago
Be an Early Applicant
United Kingdom
Senior level
United Kingdom
Senior level
Lead the design and delivery of robust ETL/ELT pipelines, drive technical leadership in data engineering, and collaborate with cross-functional teams in AWS and Databricks environments.
The summary above was generated by AI
ELEKS Software Engineering and Development Office is looking for a Lead Data Engineer in the United Kingdom.

ABOUT PROJECT
The customer is a British company producing electricity with zero carbon emissions.

REQUIREMENTS

  • 7+ years of experience in Data Engineering, including SQL and ETL (data validation, data mapping, exception handling)
  • 2+ years of hands-on experience with Databricks
  • 2+ years in a technical leadership role
  • Strong knowledge of Python
  • Practical experience with AWS services (e.g. S3, Redshift, Athena, Glue, Lambda)
  • Upper-Intermediate or higher level of English
  • Experience in energy-related domains (e.g. energy trading, utilities, power systems) — a strong advantage
  • Experience with geospatial data will be a plus
  • Ability to work on a dynamic, high-impact project in the energy sector
  • Comfortable collaborating with multinational teams and cross-functional stakeholders
  • Experience working in complex enterprise environments (defined processes, policies, and security protocols)
  • Strong interpersonal and clear, confident communication skills

RESPONSIBILITIES

  • Lead design and delivery of robust ETL/ELT pipelines with a focus on data quality and resilience
  • Drive technical leadership across the data engineering stream: architecture, coding standards, and mentoring
  • Collaborate with analysts, stakeholders, and cross-functional teams to align data solutions with business needs
  • Build and optimize data infrastructure in AWS (S3, Redshift, Glue, Lambda, etc.)
  • Use Databricks + Python to transform and orchestrate data workflows
  • Ensure compliance with enterprise security, governance, and SDLC best practices
  • Communicate proactively and clearly across teams and stakeholders in a fast-moving, international environment

WHAT WILL YOU GET WITH ELEKS

  • Close cooperation with a customer 
  • Challenging tasks 
  • Competence development 
  • Team of professionals 
  • Dynamic environment with a low level of bureaucracy

Top Skills

Athena
Aws (S3
Databricks
Glue
Lambda)
Python
Redshift
SQL

Similar Jobs

An Hour Ago
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
As a Staff Product Manager, you will define products, drive payment capabilities for platforms, and work across teams to implement solutions.
Top Skills: Embedded FinancePayments Acquiring
An Hour Ago
In-Office
London, England, GBR
Mid level
Mid level
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Manage a portfolio of clients, ensure statutory compliance, prepare meeting documents, and provide quality client service in a corporate environment.
Top Skills: Diligent
An Hour Ago
Easy Apply
Hybrid
2 Locations
Easy Apply
Senior level
Senior level
Fintech • Information Technology • Insurance • Software
The Senior Infrastructure Engineer will manage a multi-site IT infrastructure, oversee projects, collaborate with teams, and drive automation while ensuring security and compliance.
Top Skills: AWSAzureBashChromeosCi/CdGCPGitGoogle WorkspaceJAMFLinuxmacOSMeraki LanMicrosoft IntuneMist WifiNetskope SaseOktaPowershellPythonTerraformVmware Sd-WanWindows

What you need to know about the Belfast Tech Scene

If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account