The Data Platform Engineer will build and maintain data platforms, pipelines, and sources, focusing on high-quality code and sustainable energy solutions while automating data processing workflows.
Help us use technology to make a big green dent in the universe!
Kraken powers some of the most innovative global developments in energy.
We’re a technology company focused on creating a smart, sustainable energy system. From optimising renewable generation, creating a more intelligent grid and enabling utilities to provide excellent customer experiences, our operating system for energy is transforming the industry around the world in a way that benefits everyone.
It’s a really exciting time in energy. Help us make a real impact on shaping a better, more sustainable future.
At Kraken, we've developed a data platform that is used by Octopus Energy and our other clients' retail energy businesses around the world. The platform empowers users with self-service data analytics and automates data processing workflows, ranging from simple ETL jobs to ML training and prediction. The data platform team works across the whole customer domain, handling everything from natural language understanding of our customer communications to processing billions of smart meter readings every day to support clients in creating customised and market leading smart energy tariffs. As the volume, scope and geographical range of our data offerings rapidly expand, we're looking for an experienced Platform Engineer to join the team to help us build and maintain our platform, pipelines and data sources. We're passionate about building great technology to change the way customers use, and think about, energy for the good of the planet. This is a fantastic opportunity to work with us on data problems that genuinely move us closer to Net Zero, and support the energy transition. We employ software engineering best practices to design, test, and deploy our data platform and services.
What you'll have...
- First and foremost, we want our Platform Engineers to have a passion for writing high quality code and building lean processes. It would be helpful to have experience/expertise/knowledge in the following (in rough priority order):
- AWS
- Terraform/OpenTofu IAC
- Postgres
- CDC systems
- Kubernetes (EKS)
- Python
- Docker
- An interest or experience in data/network security would be a nice-to-have
- Datadog / Grafana / Prometheus
- Data related products (Airflow, Jupyter, Spark, dbt etc)
- The projects will be varied and we’re looking for someone who can work autonomously and proactively to scope problems and solve and deliver pragmatic solutions
Our tech stack
- Python as our main programming language
- Terraform for our infrastructure definition
- Kubernetes for data services and task orchestration
- Argo CD for application deployments
- Airflow purely for job scheduling and tracking
- CircleCI for continuous deployment
- Parquet and Delta file formats on S3 for data lake storage
- Postgres / Aurora for our relational databases
- Spark for data processing
- dbt for data modelling
- SparkSQL for analytics
- Streamlit for data applications
Kraken is a certified Great Place to Work in France, Germany, Spain, Japan and Australia. In the UK we are one of the Best Workplaces on Glassdoor with a score of 4.7. Check out our Welcome to the Jungle site (FR/EN) to learn more about our teams and culture.
Are you ready for a career with us? We want to ensure you have all the tools and environment you need to unleash your potential. If you have any specific accommodations or a unique preference, please contact us at [email protected] and we'll do what we can to customise your interview process for comfort and maximum magic!
Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Kraken, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. We consider all applicants without regard to race, colour, religion, national origin, age, sex, gender identity or expression, sexual orientation, marital or veteran status, disability, or any other legally protected status. U.S. based candidates can learn more about their EEO rights here.
Our (i) Applicant and Candidate Privacy Notice and Artificial Intelligence (AI) Notice, (ii) Website Privacy Notice and (iii) Cookie Notice govern the collection and use of your personal data in connection with your application and use of our website. These policies explain how we handle your data and outline your rights under applicable laws, including, but not limited to, the General Data Protection Regulation (GDPR) and the California Consumer Privacy Act (CCPA). Depending on your location, you may have the right to access, correct, or delete your information, object to processing, or withdraw consent. By applying, you acknowledge that you’ve read, understood and consent to these terms
Top Skills
Airflow
AWS
Cdc Systems
Datadog
Dbt
Docker
Grafana
Jupyter
Kubernetes
Opentofu
Postgres
Prometheus
Python
Spark
Terraform
Similar Jobs
.png)
Music
Collaborate with cross-functional teams to analyze developer experience data, define metrics, and create dashboards to drive product improvements.
Top Skills:
PythonRSQLTableau
Cloud • Social Media • Software
The Senior Software Engineer will enhance and maintain cloud data platform emulators, ensure compliance with the latest standards, and improve developer tools.
Top Skills:
SparkAthenaBigQueryDockerDuckdbGlueGoJavaJdbcKubernetesOdbcPostgresPythonRedshiftSnowflakeTrinoTypescript
Healthtech
Oversee the architecture of the Participant Data Platform, supporting data ingestion and access, ensuring operational efficiency and compliance.
Top Skills:
AirflowAWSAzureDagsterDatabricksDockerGCPGitGitHelmKubernetesPostgresPrefectSparkTerraform
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
