Data Intellect Logo

Data Intellect

Databricks Solutions Architect

Posted 3 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in Belfast, County Antrim, Northern Ireland
Mid level
Remote
Hiring Remotely in Belfast, County Antrim, Northern Ireland
Mid level
The role involves designing end-to-end data architectures, optimizing data processing performance, deploying ETL/ELT pipelines, and guiding customers in adopting Databricks solutions.
The summary above was generated by AI

Company Description

Every question matters, every pathway, direction, thought process and conversation. Because every challenge makes us stronger, more knowledgeable, more determined and more valuable to our clients.

We’re not big on egos and we’re not for the faint hearted. We stand for camaraderie, collaboration and change.

Welcome to Data Intellect.

Challenge Accepted.

Job Description

As a Databricks Solutions Architect at [DI] you will work on a variety of impactful customer technical projects, including designing and building scalable reference architectures and productionalising customer use cases within Capital Markets.

What you will be doing:

  • Define end-to-end data architectures, ensuring best practices for data governance, access control, and cost optimisation using Unity Catalog and Delta Lake 
  • Optimise query performance, storage and compute efficiency for various workloads
  • Develop and deploy ETL/ELT pipelines, enabling real-time and batch data processing
  • Implement best practices for data ingestion and transformation in financial market data environments
  • Guide strategic customers in adopting Databricks Lakehouse as a unified data platform for structured and unstructured market data
  • Enhance and grow your knowledge among subject matter experts in our learning and development ecosystem

Qualifications

  • Proficient in data engineering, data platforms and analytics
  • Deep experience with Python, SQL and/or Scala
  • Knowledge of two or more common Cloud ecosystems (Azure, AWS, GCP) with expertise in at least one.
  • Deep experience with distributed computing with Apache Spark
  • Working knowledge CI/CD for production deployments
  • Working knowledge of MLOps
  • Familiarity with designing and deploying performant end-to-end data architectures
  • Experience with technical project delivery, managing scope and timelines
  • Able to communicate complex technical concepts to business stakeholders
  • Adaptable to evolving technologies and projects
  • At least one Databricks Certification, Data or ML Engineering.

Additional Information

What we offer: 

  • Flexible working – we offer hybrid working so our people can achieve that elusive work/life balance.
  • Professional development – we offer extensive training, ranging from leadership to specific technical skills.
  • Progression opportunities - we run a biannual promotion process. Monthly 121s with your People Leader provides support to guide you and your career in the right direction.
  • International travel opportunities – we offer the opportunity to work internationally, with teams in Belfast, London, New York, Hong Kong & Singapore
  • Healthcare cover – provider is dependent on region, UK is provided by Benenden Health, including 24/7 GP Service & Mental Health Helpline to give you peace of mind when it comes to your health
  • Generous referral scheme – we love to see referrals and referring a friend means cash for you!
  • Regular social events, prizes and giveaways – our talented social committee work hard all year round to provide exciting events across all regions to promote our value of togetherness

Who We Are:

Simply put – we turn big data problems into smart data solutions.

Data Intellect is a leading data and technology consultancy specializing in creating cutting-edge financial and capital markets technology solutions. Our expertise extends to diverse industries, including smart energy and healthcare.

Fair employment and equal opportunities

Data Intellect is an equal opportunity employer, committed to inclusion and diversity.

If you have a disability, accommodations are available on request throughout the assessment and selection processes.

Ready to accept the challenge?

Apply now.

Top Skills

Spark
AWS
Azure
Ci/Cd
Databricks
Delta Lake
GCP
Mlops
Python
Scala
SQL
Unity Catalog

Data Intellect Belfast, Northern Ireland Office

Belfast, United Kingdom

Similar Jobs

6 Hours Ago
Remote
Hybrid
GB
Senior level
Senior level
Productivity • Sales • Software
Lead the Reporting team at monday.com, shaping engineering standards and fostering a culture of innovation while delivering impactful solutions.
Top Skills: AWSK8SMySQLNode.jsReactRedisRuby On Rails
6 Hours Ago
Remote
Hybrid
GB
Mid level
Mid level
Productivity • Sales • Software
Lead and mentor a team in feature development, automation, and Agile planning. Drive technical leadership and manage architecture evolution in a collaborative environment.
Top Skills: AWSElasticsearchMySQLNode.jsReactRedisReduxRuby On Rails
6 Hours Ago
Remote
Hybrid
GB
Senior level
Senior level
Productivity • Sales • Software
The Engineering Director will lead the Reporting & Analytics team, develop scalable solutions, and enhance analytics capabilities on the monday.com platform.
Top Skills: AnalyticsEngineering StrategySaaS

What you need to know about the Belfast Tech Scene

If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account