Responsible for managing data workflows and integration pipelines in hybrid IT environments, ensuring data integrity, and optimizing scripts and automation tools.
We are seeking a skilled and proactive Data Integration Engineer to join our remote team. In this role, you will be responsible for creating, optimizing, maintaining, and decommissioning data integrations across a diverse and complex hybrid IT landscape. This includes on-premises systems, SaaS platforms, and cloud environments (primarily AWS). You will play a key role in ensuring accurate, complete, and secure data flows that support both business and security initiatives.
Key Responsibilities:
- Design, build, and manage data workflows and integration pipelines across a hybrid IT environment.
- Ensure data integrity, observability, and resilience across internal systems and third-party platforms.
- Collaborate with internal stakeholders to gather requirements and deliver end-to-end integration solutions that are scalable and future-ready.
- Refactor or replace legacy data workflows to support modernized business processes.
- Identify integration inefficiencies and recommend improvements with long-term technical implications in mind.
- Maintain and develop scripts and automation tools using Python, Bash, PowerShell, and other relevant languages.
- Use DevOps practices to implement CI/CD workflows, maintain source control, and deploy changes reliably.
- Work with cloud services (especially AWS), containers, and both Linux and Windows environments.
- Integrate with and develop solutions for Splunk, including custom Splunk Apps (primarily Python-based).
- Collaborate occasionally with external stakeholders to support partner or cross-company integration efforts.
- Experience in a similar Data Integration, DevOps, or Systems Engineering role.
- Strong experience with Python, Bash, PowerShell, or similar scripting languages.
- Hands-on experience with hybrid IT environments: on-premises, SaaS, and cloud (especially AWS).
- Experience with containers (e.g., Docker), and cloud-based deployment and monitoring practices.
- Proficient in using CI/CD tools and managing code in source control systems (e.g., Git).
- Strong understanding of secure and reliable data pipeline design and observability.
- Familiarity with integrating and maintaining Splunk, including the development of custom apps.
- Ability to gather requirements, communicate tradeoffs, and deliver complete solutions independently.
- Strong communication and collaboration skills, both with internal and external stakeholders.
Preferred Qualifications:
- Experience working with infrastructure as code (e.g., Terraform, CloudFormation).
- Familiarity with additional monitoring or logging tools and data orchestration platforms.
- Prior experience supporting security-related or compliance-driven projects.
Top Skills
AWS
Bash
Ci/Cd
CloudFormation
Docker
Git
Powershell
Python
Splunk
Terraform
Similar Jobs
Payments
The Data Engineer will design and implement scalable data processing pipelines and manage data extraction, transformation, and integration from various sources.
Top Skills:
Data LakesData WarehousesETLPythonSparkSQL
Other
Design and maintain data pipelines, optimize analytics solutions, manage model training, and work on MLOps for AI-based applications.
Top Skills:
SparkAWSAzure Machine LearningDatastax AstradbHadoopHugging Face TransformersKafkaLangchainLlamaindexPlsqlPythonRedshiftSnowflakeSQL
Blockchain
As a Data Infrastructure Engineer, design and maintain high-performance databases, optimize data pipelines, and collaborate on data workflows to enhance TRM's data capabilities.
Top Skills:
AirflowDbtMySQLPostgresSQLSQL Server
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
