Leads hands-on development and production operation of secure ML, LLM, and Generative AI services. Designs RAG and agentic workflows, builds scalable AI platforms, optimizes models, implements monitoring and guardrails, and ensures reliability, security, and compliance. Collaborates with product and data teams, mentors engineers, establishes technical standards, and communicates AI capabilities across technical and non-technical audiences.
The Applied Artificial Intelligence and Machine Learning (Applied AI/ML) team within Infrastructure Platforms is transforming how the firm delivers strategic infrastructure platforms-based solutions—both by applying AI/ML within engineering workflows and by building scalable AI hosting platforms and capabilities for enterprise use.
As an Applied ML and Generative Lead within J.P.Morgan, you will operate as a hands-on engineering leader responsible for designing, building, and running production-grade ML and Generative AI services, while setting technical direction that scales across multiple workstreams. You will remain close to the code and architecture decisions, establish delivery and engineering standards, and ensure solutions meet enterprise expectations for security, stability, and operational rigor.
The ideal candidate brings a strong foundation in software engineering and AI/ML, along with proven experience leading the development and production operation of AI-enabled systems in secure, enterprise environments.
In this role, you will collaborate closely with Infrastructure Platforms AI teams to address priority use cases, design and build services, and promote best practices for scalable, resilient, and secure AI adoption. You will also mentor engineers, contribute to firmwide standards and thought leadership, and help ensure the organization stays at the forefront of AI engineering advancements.
Job Responsibilities
- Provide hands-on technical leadership by designing, developing, and deploying ML/LLM/GenAI solutions from concept through production, maintaining ownership for reliability and operability once deployed
- Work closely with product managers, data scientists, ML engineers, and other stakeholders to understand requirements and prioritize use cases.
- Develop secure, testable services and libraries that integrate LLMs, tool use, RAG, and agentic workflows.
- Build end-to-end RAG/Agentic RAG pipelines: chunking and indexing, retrieval tuning, re-ranking, grounding checks.
- Implement optimization strategies to fine-tune generative models for specific NLP use cases, ensuring high-quality outputs in summarization and text generation.
- Mentor and uplift junior engineers through design reviews, code reviews, pairing, and coaching, raising engineering quality and delivery discipline across the team.
- Implement monitoring mechanisms to track AI solution performance in real-time to ensure reliability and compliance.
- Communicate AI/ML/LLM/GenAI capabilities and results to both technical and non-technical audiences.
- Stay informed about the latest trends and advancements in the latest AI/ML/LLM/GenAI research, implement cutting-edge techniques, and leverage external APIs for enhanced functionality.
Required qualifications, capabilities, and skills
- Proven delivery of LLM-enabled applications using agentic patterns, including tool use, orchestration, guardrails, and structured outputs.
- Hands-on experience building and operating MCP integrations reliably in production.
- Hands-on experience on data-driven software/systems engineering experience delivering production services in secure, regulated environments.
- Expertise in Python engineering skills, including production-grade design, testing, debugging, and performance tuning/optimization.
- Advanced prompt engineering capabilities, including system prompts, few-shot prompting, tool/function calling, and schema-constrained outputs (e.g., JSON Schema).
- Understanding of agentic AI system layers and concepts, such as context management, harness design, and loop engineering.
- Experience building conversational AI solutions, including RAG, Agentic and Graph RAG techniques
- Experience building and scaling AI/ML workloads using distributed training/serving frameworks (e.g., Ray) and GPU acceleration (e.g., CUDA) environments.
- Proficiency with modern AI system architectures and patterns, including RAG, agentic RAG, and multi-agent systems.
- Familiarity with LLM evaluation methodologies across quality, safety, and reliability, including guardrails, content filtering, and Responsible AI practices.
- Proficiency in GenAI/agentic AI engineering practices, including data sensitivity, secure handling of inputs/outputs, and adherence to resiliency and security requirements
- Demonstrated success driving adoption of enterprise-approved AI-assisted engineering tools (coding, review, testing, troubleshooting
Preferred qualifications, capabilities, and skills
- Financial Services industry experience
- Understanding of Finops for LLMs
- Good to have Java programming experience
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The role involves researching cybersecurity threats, vulnerability analysis, developing automated tools, and collaborating with teams to provide technical expertise and publish findings.
Top Skills:
GenaiGoLinuxLlmsPythonRustWindows
Financial Services
Leads the design, research, development, and deployment of end-to-end AI solutions for corporate functions. Responsibilities include sourcing and integrating diverse data, developing and evaluating models, architecting cloud software, translating business needs into technical solutions, overseeing the software lifecycle, setting technical standards, and mentoring junior engineers. The role focuses on LLMs, generative AI, agentic systems, Python, AWS, graph technologies, and NLP.
Top Skills:
Agentic SystemsAWSGenerative AiGraph Analytics FrameworksGraph DatabasesLarge Language Models (Llms)MicroservicesNatural Language Processing (Nlp)Public CloudPythonReact
Financial Services
Designs, builds, tests, releases, and supports secure, scalable Java backend services and APIs. Leads microservices architecture, API design, data modeling, resiliency, observability, and technical decisions. Partners with product and engineering teams, conducts code reviews, mentors junior developers, and promotes secure AI-assisted engineering practices. Works with Spring Boot, REST APIs, MongoDB, CI/CD, and DevOps operating models.
Top Skills:
AgileCi/CdDevOpsJavaMicroservicesMongoDBRest ApisSpringSpring Boot
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
