Lead the design, development, and operation of scalable data pipelines using Databricks and Azure Synapse. Administer Azure data platform services, Databricks workspaces, security controls, networking, and governance. Manage infrastructure as code with Pulumi or similar tools, build CI/CD automation, monitor platform health, resolve incidents, and mentor junior colleagues while maintaining secure and reliable cloud data environments.
Overall Objectives of the Job We are seeking a skilled and experienced Senior Data / Platform Engineer to join our Data & Analytics team. This hybrid role combines hands-on data engineering on Databricks and Azure Synapse with platform administration responsibilities across our cloud data estate. The role holder will design, build, and operate scalable data pipelines while also maintaining the underlying Azure platform — including infrastructure-as-code (Pulumi), CI/CD automation, monitoring, security, and Databricks workspace administration. The ideal candidate combines strong Python/PySpark engineering skills with deep Azure platform knowledge and a service-excellence mindset, ensuring the Allianz Data Technology platform remains secure, reliable, and aligned to Allianz standards Duties and Responsibilities Lead solution design activities, collaborating with peers and mentoring junior colleagues to define and execute the team backlog. Develop, test, and document scalable ETL/ELT data pipelines and workflows using Databricks and Azure Synapse to ingest and transform data from a variety of sources. Administer and maintain Azure data platform components including Synapse, Databricks, ADLS Gen2, Key Vault, networking (VNets, NSGs, Managed Private Endpoints) and access control (RBAC, ACLs). Manage infrastructure-as-code across Dev, Staging, and Production environments using Pulumi (and equivalents such as Terraform / Bicep). Design and operate CI/CD pipelines using GitHub Actions (with OIDC federation) and/or Azure DevOps, supporting trunk-based development practices. Administer Databricks workspaces — cluster policies, Secret Scopes, Repos/Git integration, Workflow job health, and Unity Catalog governance. Monitor platform and pipeline health using Azure Monitor, Log Analytics, KQL, and Azure Dashboards; triage and resolve incidents.
Similar Jobs
Big Data • Fintech • Mobile • Payments • Financial Services
Assess financial, credit, fraud, identity, brand, compliance, and reputational risks for new and existing merchants. Review business credit reports, financial documents, payment processor statements, investigative research, and market data to determine merchant credit exposure. Monitor credit, fraud, and chargeback trends, investigate third-party data sources, collaborate with Sales and Business Development, and support automation and process improvements in merchant risk evaluation.
.png){kind=logo}
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Supports Hayu’s product development and UX efforts across customer journeys, content discovery, personalization, experimentation, research, and product analytics. Collaborates with Product, Design, Engineering, Marketing, Data, and technology partners to research customer needs, test hypotheses, evaluate feature performance, and recommend improvements for streaming experiences across mobile, web, and connected-TV platforms.
Top Skills:
A/B TestingAndroidAppleBrazeGoogle Ad ManagerProduct AnalyticsRokuSmart TvUsertestingUx/Ui Design
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead post-sales technical implementations for enterprise customers of the DX platform, design custom integrations, map platform architecture into customer workflows, run technical workshops, advise on developer experience and deployment best practices, and relay customer technical feedback to Product and Engineering to influence the roadmap.
Top Skills:
APIsBranching StrategiesCi/Cd PipelinesDeployment WorkflowsGitGithub CliPostgresPythonRestful ServicesRubyRuby On RailsSQL
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
