The role involves developing data pipelines, managing metadata and data quality in Azure, ensuring compliance with data governance standards, and collaborating with data teams.
6 Month Fixed-Term Contract
UK-wide
Remote
About the role
We are seeking an experienced Data Engineer to support the delivery of a Master Data Management (MDM) initiative and associated data governance and metadata management activities.
The role focuses on implementing scalable data pipelines, metadata management, and data quality solutions within Azure and Microsoft Purview environments. You will work closely with data governance and architecture teams to design and build robust data engineering capabilities that underpin organisational data management and reporting.
About You
UK-wide
Remote
About the role
We are seeking an experienced Data Engineer to support the delivery of a Master Data Management (MDM) initiative and associated data governance and metadata management activities.
The role focuses on implementing scalable data pipelines, metadata management, and data quality solutions within Azure and Microsoft Purview environments. You will work closely with data governance and architecture teams to design and build robust data engineering capabilities that underpin organisational data management and reporting.
About Olive Jar Digital
As we grow, we empower our teams to develop their roles and functions and offer support to get you from where you are now, to where you want to be. Moving towards our 11th year, we are now an established brand, building digital products and services and championing the provision of expert talent to enhance customer and in-house teams, satisfying all user needs.
We are a professional, fun, fully Inclusive and diverse digital consultancy, valuing everyone’s opinion. With a huge growth plan over the next two years, we are looking to expand our client facing delivery team with designers, developers, and testers as we continue to expand our project portfolio.
Responsibilities
- Design, build, and optimise data pipelines for ingestion, transformation, and delivery across structured and unstructured sources.
- Develop and maintain metadata capture processes to support data cataloguing and lineage. Implement and document data quality rules, retention policies, and data optimisation processes.
- Support large-scale deployment and configuration of Microsoft Purview.
- Establish automated scanning and metadata ingestion for source systems.
- Configure data lineage, glossary, and metadata structures to align with governance and compliance standards (UK GDPR, ISO 27001).
- Assess current data platform performance; identify and resolve bottlenecks across ingestion, processing, query, and reporting layers.
- Conduct benchmarking (e.g., latency, throughput, cost efficiency) and implement storage/DQ optimisations.
- Develop and apply storage tiering and retention strategies.
- Collaborate with Data Governance and Data Quality teams to ensure consistency, accuracy, and compliance.
- Contribute to documentation and knowledge transfer for data engineering and digital services teams.
- Participate in agile delivery ceremonies, workshops, and technical review sessions.
About You
- Strong experience in data engineering within cloud environments, ideally Azure.
- Proficiency in data pipeline development (e.g., Azure Data Factory, Databricks, Synapse, or similar).
- Experience implementing and managing Microsoft Purview or equivalent data cataloguing tools.
- Solid understanding of metadata management, data lineage, and data quality frameworks. Knowledge of data governance principles, including GDPR compliance and data retention policy design.
- Strong experience in SQL, Python, or PySpark for data manipulation and integration.
- Proven ability to optimise performance and manage large data volumes efficiently.
- Experience working in agile delivery environments with cross-functional data teams.
Similar Jobs
Cloud • Information Technology • Security • Software • Cybersecurity
Serve as the technical authority for enterprise customers in data security, owning the technical sales process. Deliver technical presentations, demos, and whiteboard sessions, advise on AI/ML-driven data protection, and drive outcomes through value-based selling with partners and GTM teams.
Top Skills:
Ai/MlData ClassificationData ProtectionDlpDspmSaaSWeb TechnologiesZscaler
Information Technology • Software
Lead design and delivery of end-to-end analytics solutions using Power BI and Microsoft Fabric. Translate business needs into scalable lakehouse architectures and data models, build and optimize pipelines, implement Fabric components, ensure data quality and governance, support presales, and promote BI DevOps best practices.
Top Skills:
Azure Data FactoryAzure Data LakeAzure SynapseCi/CdDaxFabric Dataflows Gen2Microsoft FabricNotebooksPower BIPower QuerySQLVersion Control
Artificial Intelligence • Information Technology • Software • Consulting
Hands-on data engineer responsible for designing, building and maintaining scalable AWS-native data pipelines using Apache Spark/PySpark and Airflow. Duties include pipeline development, orchestration, root-cause analysis, dimensional data modelling (SCD), infrastructure as code with Terraform, containerisation with Docker, and CI/CD via GitLab. Work within strict data governance and encryption standards in a regulated government environment.
Top Skills:
Amazon AthenaAmazon ComprehendAmazon EmrAmazon TextractApache AirflowSparkAws CloudwatchAws ConsoleAws Ec2Aws EcrAws IamAws S3Dimensional ModellingDockerGitlab Ci/CdGitlab TagsJupyter NotebooksPysparkPythonSlowly Changing DimensionsSQLTerraform
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
