Design and implement backend services integrating LLM APIs and RAG frameworks, focusing on system reliability and AI-driven features.
We’re looking for a backend-focused software engineer with a strong interest in applied AI to help us integrate LLMs, RAG pipelines, and agentic workflows into our SaaS products. This role is not about building models from scratch - it’s about engineering production-grade systems that harness existing AI models and frameworks to deliver real product value.
You’ll collaborate with product managers, LLM specialists, and domain experts to design, build, and scale intelligent features powered by modern AI technologies.
Responsibilities:
- Design and implement backend services that integrate LLM APIs (e.g., OpenAI, Claude) and retrieval-augmented generation (RAG) architectures
- Build and maintain prompt orchestration logic, agent frameworks, and tool integrations
- Work with vector databases (e.g., Pinecone, Weaviate, pgvector) to enable semantic search and retrieval
- Collaborate with product and validation teams to ensure outputs are reliable, safe, and aligned with domain expectations
- Implement monitoring, observability, and fallbacks for AI-driven services in production
- Contribute to internal SDKs, templates, and documentation for reusability across product teams
Requirements:
- 3 - 5+ years of experience as a backend or platform engineer
- Strong skills in Python, TypeScript/Node.js, or similar backend stack
- Hands-on experience with AI/LLM APIs, RAG frameworks (LangChain, LlamaIndex), or vector stores
- Understanding of prompt engineering, agent design, or AI system patterns
- Comfort working with non-deterministic systems and building safeguards around them
- Strong software engineering fundamentals: clean architecture, testing, CI/CD, logging
Nice to Have:
- Experience with agentic AI tools (LangGraph, CrewAI, etc.)
- Familiarity with LLM evaluation techniques or AI observability platforms
- Exposure to regulated environments (e.g., clinical, financial, legal tech)
We offer*:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
*not applicable for freelancers
Top Skills
AI
Langchain
Llamaindex
Llm Apis
Node.js
Pgvector
Pinecone
Python
Rag Frameworks
Typescript
Weaviate
Similar Jobs
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Lead the creation of a Consumer Data Ecosystem solution, focusing on technical development, data integration, and compliance with data privacy standards while collaborating with cross-functional teams.
Top Skills:
Ai PlatformAPIsBigQueryDataflowETLGoogle Cloud PlatformWeb Services
.png){kind=avatar}
Fintech • Software
Join this webinar to learn about career opportunities at IMC, hear from former interns, and get tips for the interview process.
Financial Services
The Advisor Summer Intern will work with teams to cater to client needs, develop market strategies, and collaborate on wealth management solutions while gaining training and mentorship from senior executives.
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
