Evaluate and compare AI/LLM-generated legal responses against a standardized rubric. Assess legal accuracy, reasoning, completeness, relevance, and commercial risk. Identify errors and differences, provide concise written feedback, and deliver consistent, objective evaluations on schedule.
This role is for one of our clients
Compensation: $150-$160 per hour
We are seeking experienced in-house legal counsel based in the United Kingdom to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving UK law.
As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional expertise will help establish reliable benchmarks for the quality, accuracy, and practical relevance of AI-generated legal work.
RequirementsKey Responsibilities
- Run identical legal prompts across two AI/LLM platforms.
- Review and compare AI-generated legal responses side by side.
- Evaluate each response against a standardized assessment rubric.
- Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
- Identify material differences, omissions, inconsistencies, and potential legal inaccuracies.
- Provide concise, precise, and well-reasoned written feedback for every evaluation.
- Apply evaluation criteria consistently and objectively across assigned tasks.
- Complete assignments independently while adhering to project guidelines and deadlines.
- 5+ years of experience as in-house legal counsel practicing in the United Kingdom.
- Strong command of UK law, particularly commercial and contract matters.
- Practical experience advising businesses and assessing real-world legal and commercial risks.
- Excellent attention to detail and strong analytical judgment.
- Exceptional written English and the ability to communicate complex legal concepts clearly and concisely.
- Ability to distinguish legally accurate analysis from plausible but incorrect or incomplete reasoning.
- Comfortable working independently with structured evaluation rubrics.
- Strong ability to manage deadlines and consistently deliver high-quality assessments.
- Initial Commitment: Approximately 10 hours
- Potential: Strong possibility of additional work based on project requirements and performance
- Work Arrangement: Fully remote
- Confidentiality: All project work will be subject to applicable confidentiality requirements and NDA obligations.
- Engagement Type: Independent contractor
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms- This is a fully remote engagement that can be completed on a flexible schedule.
- Projects may be extended, shortened, or concluded early depending on project requirements and performance.
- Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
- Payments are made weekly based on services rendered through supported payment platforms.
Similar Jobs
Cloud • HR Tech • Information Technology • Software
Sell complex SaaS solutions to large enterprise organizations, managing complete sales cycles and presenting to C-level executives. Build trusted stakeholder relationships, develop territories, create new business opportunities, execute account plans, deliver product demonstrations, and collaborate cross-functionally to maximize revenue. Candidates should have at least five years of sales-target success, experience with six-figure deals, enterprise sales expertise, and a record of recognized performance.
Top Skills:
SaaSSales Management Software
Cloud • HR Tech • Information Technology • Software
Generate and qualify UK business opportunities through inbound lead management and outbound prospecting, including cold calling, email outreach, and social selling. Partner with Enterprise Sales, Marketing, and Revenue Operations to build pipeline, qualify leads, schedule meetings, and support territory growth. Maintain accurate CRM data, meet sales development targets, and engage senior decision-makers about employee recognition solutions.
Top Skills:
Salesforce
eCommerce • Enterprise Web • Information Technology • Software • Database • Analytics • Business Intelligence
Serve as a trusted technical advisor for complex enterprise SaaS sales across EMEA. Partner with Account Executives to guide technical strategy, design tailored demonstrations, lead proof-of-concepts, define success criteria, architect scalable solutions, and quantify business value. Engage technical stakeholders and C-suite executives, support RFPs, coordinate with Product and Engineering, and influence the product roadmap through customer feedback. Requires English and Italian proficiency and 25–30% travel across EMEA.
Top Skills:
Agentic AiCSSEnterprise Data ArchitectureHTMLJavaScriptSaaSTagging Strategies
What you need to know about the Belfast Tech Scene
If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.
