The Azure Data Engineer designs and manages data solutions, builds ETL pipelines, and analyzes large volumes of data using various Azure tools to support data-driven decision-making.
About Avalere Health
At Avalere Health, we are powered by a single, unifying mission to make EVERY PATIENT POSSIBLE. Our three capabilities – Advisory, Medical, and Marketing – move as one, seamlessly collaborating to ensure every patient is identified, supported, treated, and cared for, equally.
Achieving our mission starts with providing enriching, purpose-driven careers for our team that empower them to make a tangible impact on patient lives. We are committed to creating a culture where our employees are empowered to bring their whole selves to work and tap into the power of diverse backgrounds and skillsets to play a part in making a difference for every patient, everywhere.
Our flexible approach to working allows our global teams to decide where they want to work, whether in-office or at home based on team and client need. Major city hubs in London, Manchester, Washington, D.C., and New York, and smaller offices globally, serve as collaboration hubs allowing our teams to come together when it matters. Homeworkers are equally supported, with dedicated social opportunities and resources.
Our inclusive culture is at the heart of everything we do. We proudly support our employees in bringing their whole selves to work with our six Employee Network Groups – Diverse Ability, Family, Gender, LGBTQ+, Mental Health, and Race/Ethnicity. These groups provide opportunities to promote diversity, equity, and inclusion and to connect, learn, and socialise through regular meetings and programs of activity. We are an accredited Fertility Friendly employer with our Fertility Policy, enhanced parental leave, and culture of flexibility ensuring every employee feels supported across their family planning journey and can work in a way that suits their family’s needs.
We are deeply invested in supporting professional growth for our employees through day-to-day career experiences, access to thousands of on-demand training sessions, regular career conversations, and the opportunity for global, cross-capability career moves.
We take pride in being part of the Disability Confident Scheme. This helps make sure you can be interviewed fairly if you have a disability, long term health condition, or are neurodiverse. If you'd like to apply and need adjustments made, you can let us know in your application.
About the role
As an Azure Data Engineer, your role involves designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. Your responsibilities will include, but not limited to:
Data Integration
Data Integration and ETL (Extract, Transform, Load): You’ll develop and implement data integration processes to extract data from diverse sources and load it into data warehouses or data lakes.
Azure Data Factory is a key tool for building efficient ETL pipelines. Your goal is to ensure that data is effectively cleaned, transformed, and loaded.
Your sources will include Rest API from various systems. Being able to onboard data from API's is essential. Use of Postman for testing outside of ADF is a preferred skill.
Data Engineering
As an Azure Data Engineer, you’ll handle and analyse large volumes of data using big data technologies available on the Azure platform.
Your responsibilities include creating data processing workflows and pipelines to support data analytics, machine learning, and other data-driven applications.
1. In summary, your role revolves around building data processing pipelines, creating analytics solutions, and enabling data-driven decision-making within organizations using Azure cloud tools
2. Keep honing your skills, as the demand for Microsoft Certified Data Engineers continues to grow!
Data Management and Storage:
You’ll work with various data storage options provided by Microsoft Azure, including Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage.
Your task is to design data storage systems that scale, perform efficiently, and meet the organisation’s requirements.
Essential Skills
- Proficiency in SQL, SQL Server
- Understand parallel processing and data architecture patterns
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Azure Data Lake Storage
- Ability to design and implement pipelines in ADF.
- Build complex efficient processes for transformation using SQL & ADF Pipelines
- Ensure secure, organised, and reliable data pipelines
- Troubleshoot all data quality issues
- Your core foundation will be data analytics which lead you to becoming a data engineer
Data Migration
- You will use Data Factory, Dedicated and serverless SQL DB's and Syanpse.
- You will pull data from API's & other sources; you will stage and transform this data before converting to JSON and loading into the target using API endpoints.
- You will analyse all sources to understand the data (with business support).
- You will build processes to validate and highlight exceptions that sit outside any migration rules.
- You will successfully load data into target on multiple passes and process any feedback into changes necessary for a successful go live.
What we can offer
You'll receive up to a 7% pension contribution, life insurance, income protection, and private medical insurance for peace of mind. Enjoy flexible working arrangements, including flexible hybrid working, along with the option to work from anywhere across the globe two weeks each year. We provide 25 days of annual leave plus two personal well-being days, along with gifted end-of-year holidays and an early Summer Friday finish in June, July, and August.
Access free counselling through our employee assistance program, as well as personalized health support. Enhanced maternity, paternity, family leave, and fertility policies provide support across every stage of your family-planning journey, as well as on-demand support from our partner Peppy. You can also benefit from continuous opportunities to professionally develop with on-demand training, support, and global mobility opportunities across the business.
We encourage all applicants to read our candidate privacy notice before applying to Avalere Health.
Top Skills
Azure Blob Storage
Azure Data Factory
Azure Data Lake Storage
Azure Sql Database
Azure Synapse Analytics
SQL
SQL Server
Similar Jobs
Information Technology
The Data Engineer will build, manage, and optimize complex data solutions using cloud technologies, leading the team, and ensuring data integrity and cost efficiency.
Top Skills:
AzureAzure Blob StorageAzure Data FabricCosmosdbFmeHadoopJavaKafkaPostgresPysparkPythonRRabbitMQSparkSpark SqlSQL
Information Technology
Join our Data Engineering team to build advanced data solutions and manage large-scale data processing systems while leading and inspiring others.
Top Skills:
AzureFmeHadoopKafkaPythonSparkSQL
Information Technology • Social Impact
The Data Engineer will design and implement data solutions, optimize data processing systems, collaborate with stakeholders, and contribute to the engineering practice.
Top Skills:
Apache AirflowSparkApache SupersetAzure Data StackCi/CdDockerKubernetesPower BIPythonSQLSql Server Integration Services (Ssis)SsrsT-Sql
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
