NewDay Logo

NewDay

Lead Data Engineer

Posted 4 Days Ago
Be an Early Applicant
In-Office
London, Greater London, England
Senior level
In-Office
London, Greater London, England
Senior level
Lead and mentor a team of data engineers, define technical vision, collaborate with stakeholders, develop data pipelines, and ensure data quality.
The summary above was generated by AI

What you will deliver

  • Lead and Mentor: Lead, manage, and mentor a team of 3-6 data engineers, fostering a collaborative and high-performing environment.

  • Technical Vision & Ownership: Own and define the technical vision, providing architectural guidance and best practices for data modelling, ETL/ELT processes, data warehousing, and data lake solutions.

  • Collaboration & Stakeholder Management: Work closely with Product Owners, Business Analysts, and other stakeholders to understand requirements, translate them into technical specifications, and ensure successful delivery of data solutions.

  • Hands-on Development: Be a hands-on contributor to the design, development, and maintenance of scalable data pipelines and platforms, leveraging a modern data stack.

  • Data Quality & Testing: Implement and champion robust testing strategies for data pipelines, including unit testing, integration testing, and data quality checks, to ensure accuracy, reliability, and completeness of data.

Your Skills and Experience

Essential

  • Extensive Data Engineering Experience: Proven experience as a Senior or Lead Data Engineer, with a strong track record of designing, building, and maintaining complex data pipelines and platforms.

  • Technical Expertise:

    • Languages: Strong proficiency in Python and SQL.

    • Cloud Platform: Hands-on experience with AWS services (EMR, Athena, Lambda, S3, Glue, Step Functions).

    • Data Warehousing: In-depth experience with Snowflake.

    • Big Data Processing: Experience with Spark and familiarity with Scala (even if limited).

    • Orchestration: Solid experience with Airflow for workflow orchestration.

    • Data Transformation: Hands-on experience with DBT (Data Build Tool).

    • Version Control: Proficient with Git and GitHub, including experience with GitHub Actions for CI/CD.

  • Leadership & Management:

    • Demonstrated experience in leading, mentoring, and managing a team of data engineers.

    • Ability to motivate and inspire a team, fostering a culture of continuous learning and excellence.

    • Strong communication and interpersonal skills, with the ability to effectively collaborate with technical and non-technical stakeholders.

Desirable

  • Real-time data processing

  • Data governance and data quality frameworks

  • Data operations and observability

#LI-Hybrid

#LI-TM1

We work with Textio to make our job design and hiring inclusive.

Permanent

Top Skills

Airflow
AWS
Dbt
Git
Git
Python
Scala
Snowflake
Spark
SQL

Similar Jobs

Yesterday
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Fintech • Software • Financial Services
The Lead Data Engineer will manage a data engineering team, oversee data pipeline operations and drive the migration to a new data stack while ensuring data quality and governance.
Top Skills: AWSDbtPythonSnowflakeSQL
10 Days Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
As a Lead ML Ops & Data Engineer, you'll develop automated pipelines, collaborate with teams to ensure efficient ML Ops, and maintain high-quality data sources.
Top Skills: AirflowCi/CdData EngineeringMl OpsMlflowPython
19 Days Ago
In-Office
London, England, GBR
Senior level
Senior level
Software
Lead Data Engineers at Thoughtworks manage data engineering projects, design technical solutions, and collaborate with stakeholders while ensuring data governance and security.
Top Skills: AzureDatabricksFabricGCPSnowflake

What you need to know about the Belfast Tech Scene

If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account