Lead Data Engineer responsible for shaping the Snowflake platform architecture, mentoring data engineers, and optimizing data solutions. Responsibilities include managing Agile delivery, implementing ELT pipelines, ensuring data quality, and applying security protocols while facilitating communication with stakeholders.
Allata is a global consulting and technology services firm with offices in the US, India, and Argentina. We help organizations accelerate growth, drive innovation, and solve complex challenges by combining strategy, design, and advanced technology. Our expertise covers defining business vision, optimizing processes, and creating engaging digital experiences. We architect and modernize secure, scalable solutions using cloud platforms and top engineering practices.
Allata also empowers clients to unlock data value through analytics and visualization and leverages artificial intelligence to automate processes and enhance decision-making. Our agile, cross-functional teams work closely with clients, either integrating with their teams or providing independent guidance—to deliver measurable results and build lasting partnerships.
We’re looking for a hands-on Lead Data Engineer to own and evolve our clients’ Snowflake data platform. You’ll lead and mentor a squad of data engineers, shape the technical roadmap, and deliver high-quality, cost-efficient, and secure data solutions. This role blends architecture, delivery leadership, and coding—ideal for someone who can set standards, coach others, and still dive deep when needed.
Role & Responsibilities:
- Define and evolve Snowflake platform architecture, standards, and best practices.
- Translate business goals into a pragmatic technical roadmap and delivery plan.
- Lead and mentor data engineers; establish quality bars, review code, and guide execution.
- Manage delivery using Agile rituals; align priorities across data, analytics/BI, and application teams.
- Design, build, and optimize ELT pipelines on Snowflake with an ELT-first approach (dbt preferred).
- Implement modern data ingestion using tools such as Fivetran, ADF, Glue, or Matillion.
- Set up orchestration and CI/CD for data using Airflow or Dagster and Git-based pipelines.
- Ensure data quality, observability, monitoring, alerting, documentation, and runbooks.
- Apply performance tuning and cost optimization in Snowflake, including query profiling and warehouse sizing.
- Implement security and governance in Snowflake (RBAC, masking, row access policies, auditing, data sharing).
- Facilitate discovery with stakeholders, clarify requirements, and communicate trade-offs and recommendations.
Hard Skills - Must have:
- Deep hands-on Snowflake experience: warehouses, databases/schemas, stages, file formats, external tables, Snowpipe, Streams and Tasks, Time Travel/Fail-safe, query performance, micro-partitions, clustering, and cost management.
- Strong SQL and Python for data engineering use cases.
- ELT-first development with dbt or an equivalent modeling/testing/documentation framework.
- Experience with modern ingestion and orchestration (Fivetran, ADF, Glue, Matillion, Airflow, or Dagster).
- Cloud experience (AWS preferred; Azure or GCP considered), including storage, IAM, networking basics, and secrets management.
- CI/CD for data with Git-based workflows and environment promotion.
- Familiarity with Infrastructure as Code (e.g., Terraform Snowflake provider).
- Solid understanding of dimensional modeling and data quality practices.
Nice to have/It's a plus:
- Snowpark (Python), UDFs or stored procedures, and Dynamic Tables.
- Streaming or CDC with Kafka, Kinesis, or Debezium; event-driven patterns.
- BI or semantic layer exposure (Power BI, Tableau, Looker); metrics layer concepts.
- Experience with Azure Synapse, Microsoft Fabric, or Databricks in lakehouse contexts.
- Security and compliance exposure (PII handling, encryption, auditing, regulated environments).
Soft Skills:
- Proven leadership with coaching, feedback, objective setting, and conflict resolution.
- Excellent stakeholder communication; able to facilitate discovery and manage expectations.
- Ownership mindset with proactive risk identification, prioritization, and mitigation.
- Structured problem-solving; comfortable with ambiguity and change.
At Allata, we value differences.
Allata is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Allata makes employment decisions without regard to race, color, creed, religion, age, ancestry, national origin, veteran status, sex, sexual orientation, gender, gender identity, gender expression, marital status, disability or any other legally protected category.
This policy applies to all terms and conditions of employment, including but not limited to, recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
Top Skills
Adf
Airflow
AWS
Azure
Dbt
Fivetran
GCP
Git
Glue
Matillion
Python
Snowflake
SQL
Terraform
Similar Jobs
.png)
Fintech • Real Estate • Financial Services
As a Senior Data Engineer, you will build Crowd Street's data platform, manage data pipelines, and collaborate with teams to meet data needs.
Top Skills:
Azure Data FactoryAzure Synapse AnalyticsAzureMicrosoft Power BiPython
Information Technology • Security • Cybersecurity
As a Senior Data Engineer, you will build and maintain big data pipelines, engage in all software development phases, and collaborate with cross-functional teams to enhance system performance and stability.
Top Skills:
AirflowSparkAWSClickhouseDockerHiveJenkinsKafkaKafka ConnectPostgresPythonRedisScalaScylladbTerraform
_1.png)
Other
As a Senior Data Engineer, you will enhance the data lakehouse, optimize data workloads, perform complex transformations, and develop frameworks to improve delivery velocity, focusing on cybersecurity solutions.
Top Skills:
Cloud Data ProcessingData WarehousingDatabricksDistributed Processing FrameworkPythonSpark
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
