As a Senior Data Engineer, you'll develop and optimize data pipelines for a Consumer Data Lake, ensuring data accuracy and compliance with privacy regulations while collaborating with cross-functional teams.
Join an exciting journey to create a greenfield, cutting-edge Consumer Data Lake for a leading global organization based in Europe. This platform will unify, process, and leverage consumer data from various systems, unlocking advanced analytics, insights, and personalization opportunities. As a Senior Data Engineer, you will play a pivotal role in shaping and implementing the platform's architecture, focusing on hands-on technical execution and collaboration with cross-functional teams.
Your work will transform consumer data into actionable insights and personalization on a global scale. Using advanced tools to tackle complex challenges, you’ll innovate within a collaborative environment alongside skilled architects, engineers, and leaders.
Key Responsibilities:
- Hands-On Development: Build, maintain, and optimize data pipelines for ingestion, transformation, and activation.
- Create and implement scalable solutions to handle diverse data sources and high volumes of information
- Data Modeling & Warehousing: Design and maintain efficient data models and schemas for a cloud-based data platform.
- Develop pipelines to ensure data accuracy, integrity, and accessibility for downstream analytics.
- Collaboration: Partner with Solution Architects to translate high-level designs into detailed implementation plans.
- Work closely with Technical Product Owners to align data solutions with business needs.
- Collaborate with global teams to integrate data from diverse platforms, ensuring scalability, security, and accuracy.
- Platform Development: Enable data readiness for advanced analytics, reporting, and segmentation.
- Implement robust frameworks to monitor data quality, accuracy, and performance.
- Testing & Quality Assurance: Implement robust security measures to protect sensitive consumer data at every stage of the pipeline
- Ensure compliance with data privacy regulations (e.g., GDPR, CCPA ..) and internal policies.
- Monitor and address potential vulnerabilities, ensuring the platform adheres to security best practices.
Requirements:
- Over 4+ years of experience showcasing technical expertise and critical thinking in data engineering.
- Hands-on experience with DBT and strong Python programming skills.
- Proficiency in Snowflake and expertise in data modeling are essential.
- Demonstrated experience in building consumer data lakes and developing consumer analytics capabilities is required.
- In-depth understanding of privacy and security engineering within Snowflake, including concepts like RBAC, dynamic/tag-based data masking, row-level security/access policies, and secure views.
- Ability to design, implement, and promote advanced solution patterns and standards for solving complex challenges.
- Strong experience with Azure and familiarity with other cloud platforms
- Practical experience with Big Data batch and streaming tools.
- Competence in SQL, NoSQL, relational database design (SAP HANA experience is a bonus), and efficient methods for data retrieval and preparation at scale.
- Proven ability to collect and process raw data at scale, including scripting, web scraping, API integration, and SQL querying.
- Experience working in global environments and collaborating with virtual teams.
- A Bachelor’s or Master’s degree in Data Science, Computer Science, Economics, or a related discipline.
We offer*:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
*not applicable for freelancers
Top Skills
Azure
Dbt
GCP
NoSQL
Python
Sap Hana
Snowflake
SQL
Similar Jobs
Information Technology • Security • Software • Cybersecurity • App development • Data Privacy
Lead the product strategy and operations for CleanMyMac, focusing on user experience, innovation, and team transformation in alignment with MacPaw's ecosystem.
Top Skills:
AIB2CiOSmacOSUx
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
The EMEA Sales Leader will drive the company's expansion in the region, establish sales pipelines, develop partnerships, and oversee the sales team.
Top Skills:
AIB2B SaasMachine LearningSales Management
Machine Learning • Natural Language Processing
Join a community of linguists and contribute to AI through annotation, evaluation, and prompt creation in a flexible, remote role.
Top Skills:
Digital Tools
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
