The Data Engineer will design and maintain data infrastructure, build scalable data pipelines, ensure data integrity, and integrate third-party data sources for analytical capabilities.
We are looking for an experienced Data Engineer to design and maintain robust data infrastructure across our systems. In this role, you will be responsible for building scalable data pipelines, ensuring data integrity, and integrating third-party data sources. Your primary focus will be to enable efficient data flow and support analytical capabilities across the organization. You will also contribute to the development of our data architecture, implement best engineering practices, and collaborate closely with cross-functional teams to turn raw data into actionable insights.
Responsibilities- Communicate with both technical and non-technical audiences to gather requirements
- Review and analyze data and logic to ensure consistency and accuracy
- Design, implement, and maintain data pipelines for efficient data flow
- Integrate and support of developed solutions
- Research and evaluate third-party components for potential use
- Follow best engineering practices: refactoring, code review, testing, continuous delivery, and Scrum
- Design, optimize, and support of data storage
Requirements
- At least 3+ years of experience in data engineering
- Experience in requirement gathering and communication with stakeholders
- Strong knowledge of DWH (data warehouse) architecture and principles
- Practical experience building ETL pipelines and designing data warehouses
- Deep experience with Python with a strong focus on PySpark
- Proficiency in SQL and databases such as PostgreSQL, ClickHouse, MySQL
- Hands-on experience with data scraping and integrating third-party sources and APIs
- Solid understanding of software design patterns, algorithms, and data structures
- Intermediate English proficiency
Will be a plus
- Experience with RabbitMQ or Kafka
- Understanding of web application architecture
- Familiarity with DataOps practices
- Background in FinTech or Trading domains
We offer
- 20 paid vacation days per year
- 10 paid sick leave days per year
- Public holidays as per the company's approved Public holiday list
- Medical insurance
- Opportunity to work remotely
- Professional education budget
- Language learning budget
- Wellness budget (gym membership, sports gear and related expenses)
Top Skills
Clickhouse
Kafka
MySQL
Postgres
Pyspark
Python
RabbitMQ
SQL
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
Develop new features, review database changes, document best practices, and improve product performance in backend engineering focusing on data frameworks.
Top Skills:
KafkaNatsPostgresRubyRuby On Rails
Information Technology • Consulting
As a Data Engineer, you will design and implement big data solutions, analyze data for insights, and support data integration and API development.
Top Skills:
SparkAWSAzureAzure Data Lake StorageDatabricksDockerFast-ApiGCPPythonSQL
Information Technology • Consulting
Join our team as a Data Engineer, focusing on database design, ETLs, and BI reporting while maintaining high server performance and access rights management.
Top Skills:
CassandraFlywayJavaLinuxLiquibaseMongoDBMySQLOraclePl/SqlPostgresPythonSolarisSQL ServerT-SqlWindows
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
