The Senior Data Scientist will design, evaluate, and optimize AI models and datasets to develop scalable AI solutions that empower SMBs. Responsibilities include model evaluation, data preparation, prompt engineering, and deployment of LLMs while collaborating across teams. The role focuses on solving real-world AI challenges and driving business impact through innovative solutions.
The world of AI and GenAI is evolving rapidly, and we’re on a mission to build a powerful AI platform that drives innovation across all PandaDoc products. Our goal is to develop scalable, impactful AI solutions that empower small and medium-sized businesses (SMBs) to thrive. We’re looking for a Senior Data Scientist who is passionate about solving real-world challenges with AI and enjoys working in a fast-paced, high-impact environment.
This is a unique opportunity to design, evaluate, and optimize AI models, datasets, and pipelines—helping us turn cutting-edge AI into practical, scalable solutions for tens of thousands of businesses.
What makes this role special?
- AI-First Products – Develop models and systems that enable AI-first experiences, enhancing the value we provide to SMBs.
- High Impact, High Ownership: You’ll have the freedom to build and lead, working cross-functionally with engineers, designers, and product managers and bring the best practices from the industry.
- Real-World AI Challenges: You’ll tackle the complexities of productizing AI and Gen-AI applications—from scalability and observability to security and fine-tuning.
- Innovation at Scale: Your work will enable fast, iterative experimentation for customer-facing AI solutions, helping SMBs grow, compete, and thrive.
In this role, you will:
- Model Evaluation & Testing – Create evaluation frameworks to assess LLMs and GenAI applications, measuring recall, effectiveness, and accuracy.
- Dataset Creation & Data Preparation – Develop high-quality datasets for model training, fine-tuning, and inference.
- Prompt Engineering & Optimization – Establish evaluation pipelines for prompt performance, ensuring reliability and efficiency.
- Model Fine-Tuning – Optimize LLMs for specific business use cases to improve their effectiveness.
- LLM Deployment & Guardrails – Deploy LLMs in production and implement systems to maintain model constraints and safe usage.
- Multi-Model Support – Work with various LLMs (e.g., GPT-4, Claude, fine-tuned models) for efficient routing and task handling.
- AI-Driven Automation – Contribute to AI-powered automation systems that enhance customer workflows and streamline routine tasks.
- Collaboration Across Teams – Work closely with PMs, designers, and engineers to define AI requirements and bring solutions to life.
About you:
- Python Expertise – 5+ years of experience in Python using in DS.
- GenAI Experience – Hands-on experience with LLMs, RAG, knowledge graphs and fine-tuning.
- LLM Evaluation & Optimization – Proven ability to measure and improve model performance.
- Dataset & Data Preparation Skills – Expertise in building and curating datasets for AI training.
- Production Deployment – Experience deploying LLMs and implementing guardrails for responsible AI usage.
- Trend Awareness – Stays updated on the latest AI research, tools, and frameworks, identifying ways to apply them effectively.
- Customer-Centric Mindset – Passion for building AI solutions that provide real value to end users.
- Fast-Paced & Independent – Thrives in a high-speed environment with autonomy to solve problems.
- Product-Driven Approach – Focuses on building AI solutions that drive tangible business impact.
Why PandaDoc?
At PandaDoc, we’re committed to helping SMBs succeed by providing AI-powered tools that simplify their workflows and drive efficiency. With over 60,000 businesses trusting our platform, we’re now investing in AI to take our impact even further.
You’ll be part of a collaborative, high-energy team that values creativity, autonomy, and real-world impact. If you’re excited about solving complex AI challenges and building tools that matter, let’s talk!
Top Skills
Data Preparation
Deployment
Genai
Knowledge Graphs
Llms
Model Evaluation
Prompt Engineering
Python
Rag
Similar Jobs
Information Technology • Consulting
The Senior Data Scientist will apply machine learning models to real-world datasets to predict financial figures and optimize advertising prices. Responsibilities include developing user-facing chatbots, improving methods from statistics and deep learning to solve business problems, and communicating findings to both technical and non-technical stakeholders.
Top Skills:
AWSDockerLangchainLightgbmPalantir FoundryPythonTensorFlowTorchXgboost
Healthtech
The Data Science Engineer will lead client projects focused on data privacy and provide data science support for scalable architectures and workflows. Responsibilities include analyzing data re-identification risks, developing data processing solutions, and ensuring compliance with privacy regulations. The role involves collaboration and documentation of processes and methodologies.
Top Skills:
AWSAzureConfluenceDockerGCPGitJavaJenkinsJIRAJupyter NotebookMatplotlibNumpyPandasPytestPythonPyTorchScikit-LearnSQLUnittest
Artificial Intelligence • Enterprise Web • Software
As a Senior Technical Product Marketing Manager at Sanity.io, you'll connect product capabilities to developer and IT leader needs, create impactful messaging and resources, engage with the community, and translate technical features into accessible value-driven content.
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
