Lead design and development of scalable data pipelines, optimize ETL processes, ensure platform quality, and collaborate across teams to enhance data architecture.
Summary
The Data Platform team at Pismo is responsible for integrating data produced by Pismo's Banking as a Service/Payments platform with its clients, whether through batch processing (files) or near real-time (events). With a robust, low-latency, and 100% cloud-based architecture, the team excels in
technology and fosters a strong culture of collaboration, partnership, and data-driven decision making for platform development and project prioritization.
What you'll do- Serve as a senior technical contributor on Pismo’s data stack, leading the design and development of robust, scalable data pipelines using modern Big Data frameworks.
- Drive continuous improvement in platform performance, reliability, and cost-effectiveness, proactively identifying opportunities for innovation.
- Take ownership of production operations and monitoring (file- and event-based systems), ensuring adherence to SLAs and applying best practices for observability and resilience.
- Collaborate with cross-functional teams to architect, build, and evolve high-complexity data features, reducing technical debt and championing engineering excellence.
- Provide mentorship to peers through code reviews, feedback, and support, fostering an environment of knowledge sharing and professional development.
- Participate in on-call rotations, promptly addressing and resolving production incidents, while proactively implementing preventative measures.
- Build and optimize ETL/ELT processes to handle large-scale data, leveraging advanced data processing and distributed systems techniques.
- Maintain rigorous data governance and platform standards, working closely with data stakeholders to ensure consistent, high-quality data assets.
- Introduce and adopt new technologies, tools, or techniques that accelerate development cycles, improve performance, and reduce costs.
- Conduct root-cause analyses for critical issues, challenging and refining team processes to enhance efficiency and reliability.
- Influence multiple teams by promoting a culture of technical excellence, forward-thinking solutions, and continuous improvement.
Technical Skills:
- 3+ Years experience with Golang
- 3+ Years experience with AWS Services ( Lambda, SQS, S3 )
- 2+ Years experience with Terraform
- Software Engineering experience ( building steaming applications / data platforms )
- Python experience
--
Pismo is an Equal Employment Opportunity employer that proudly pursues and hires a diverse workforce. Pismo does not make hiring or employment decisions on the basis of race, color, religion or religious belief, ethnic or national origin, nationality, sex, gender, gender identity, sexual orientation, disability, age or any other basis protected by applicable laws or prohibited by company policy. Pismo also strives for a healthy and safe workplace and strictly prohibits harassment of any kind.
Top Skills
AWS
Go
Python
Terraform
Similar Jobs
Financial Services
As a Senior Data Engineer, you will develop data architectures, ensure regulatory compliance, and lead data initiatives within Wholesale Credit Risk.
Top Skills:
SparkAWSAzureDatabricksDelta LakeGCPHadoopJavaKafkaKubernetesPythonSnowflakeSQL
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Senior Data Engineer, you'll design and build secure data pipelines for financial institutions, collaborating on digital transformation initiatives.
Top Skills:
AirflowAWSAzureBigQueryCircleCIGCPHadoopJavaJenkinsKafkaKinesisPythonRedshiftScalaSnowflakeSparkSpark StreamingSQL
AdTech • Digital Media • Marketing Tech • Mobile
As a Senior Data Engineer, you will optimize ETL/ELT pipelines, enhance data processes, implement robust testing strategies, and support data systems operations at Kargo.
Top Skills:
AerospikeAirflowAWSDockerFlinkIcebergKafkaKubernetesPythonSnowflakeSpark
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
