Photon Logo

Photon

Data Engineer | London, UK

Reposted 3 Months Ago
Remote
Hiring Remotely in United Kingdom
Mid level
Remote
Hiring Remotely in United Kingdom
Mid level
Support ledger migration and data lake cleanup by extracting, transforming, reconciling and validating large datasets. Develop and validate SQL queries, batch jobs and processing logic, perform regression testing, document mappings and validation rules, and collaborate with engineering, product and business teams to ensure production readiness and post-migration validation.
The summary above was generated by AI

Role Summary 

We are looking for experienced Data Engineers / Data Analysts to support a ledger migration and data clean-up initiative across the data lake, reporting and downstream feeds. The role will involve working on large-scale batch processing, data validation, regression testing and migration readiness activities within a financial services environment. 

Key Responsibilities 

  • Support ledger migration activities, including data extraction, transformation, reconciliation and validation. 

  • Work on data lake clean-up, data quality checks, reporting pipelines and downstream feeds. 

  • Develop, enhance and validate SQL queries, batch jobs and data processing logic. 

  • Perform regression testing on batch processes to ensure data accuracy and completeness before and after migration. 

  • Collaborate with engineering, product and business teams to understand migration requirements and resolve data issues. 

  • Document data mapping, validation rules, test results and migration exceptions clearly. 

  • Support production readiness, defect triage and post-migration validation activities. 

Required Skills and Experience 

  • Strong hands-on experience with SQL and data analysis across large datasets. 

  • Experience with batch processing, batch regression testing and data reconciliation. 

  • Working knowledge of Spark or similar distributed data processing technologies. 

  • Experience working with data lakes, reporting platforms, feeds and data migration programmes. 

  • Ability to identify data inconsistencies, investigate root causes and support remediation. 

  • Strong understanding of data quality, controls, validation and auditability in enterprise environments. 

  • Good communication skills with the ability to work across engineering, business and product stakeholders. 

Preferred Experience 

  • Prior experience in financial services, banking, ledger systems or regulatory data environments. 

  • Experience supporting enterprise-scale migration, modernisation or platform transformation programmes. 

  • Exposure to reporting, dashboards, data views and operational data feeds. 

  • Ability to work in distributed teams across London, Bangalore and Singapore. 

Similar Jobs

Yesterday
Remote or Hybrid
Belfast, County Antrim, Northern Ireland, GBR
Expert/Leader
Expert/Leader
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Architect and operate scalable cloud and virtualized security demonstration platforms for global sales engineering teams. Automate realistic threat scenarios, self-service lab tooling, product integrations, and deployment workflows. Lead technical readiness for conferences and evaluations, resolve infrastructure incidents, enforce security governance, and coordinate multi-quarter initiatives across engineering, product, information security, and go-to-market teams.
Top Skills: AWSAzureBashCi/CdCloudFormationGCPLinuxPowershellPythonRapid7 Command PlatformTerraformUnixWindows Server
Yesterday
Easy Apply
In-Office or Remote
United Kingdom
Easy Apply
Junior
Junior
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Own the full sales cycle for mid-market UK customers operating 50–174 trucks, from prospecting and discovery through negotiation and closing. Generate outbound leads, conduct demos and trials, meet revenue quotas, forecast accurately, and collaborate with sales development, engineering, customer success, and professional services teams. The hybrid London role requires office attendance three days weekly and customer-site travel up to three times monthly.
Top Skills: SaaS
Yesterday
Remote or Hybrid
Internship
Internship
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Supports the Director of Partner Marketing in promoting film and television titles, meeting client needs, developing revenue-driving ideas, coordinating meetings and trackers, managing competing deliverables, assisting with copywriting, and overseeing creative asset workflows. The intern will gain experience in relationship management, prioritization, software use, and collaboration across international teams in a major studio environment.
Top Skills: Adobe PhotoshopExcelMicrosoft Powerpoint

What you need to know about the Belfast Tech Scene

If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account