Project Overview:

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking a skilled Senior U.S.-Licensed Attorney to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.

Location: U.S.-based experts only

Engagement: Part-time, project-based expert evaluation work

Work Type: Remote

Project Summary:

Senior legal experts will design realistic, complex legal prompts, evaluate AI-generated legal reasoning, and produce gold-standard responses to benchmark and improve advanced language models.

Consultant Engagement Terms:

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).

Responsibilities:

Contributors will:

• Create high-complexity legal prompts based on real-world professional workflows
• Define criteria-based rubrics for evaluating legal reasoning quality
• Evaluate AI model outputs against expert legal standards
• Identify reasoning gaps, incorrect assumptions, and omissions
• Author gold-standard legal responses reflecting senior-level judgment

Expected Outcomes:

• Realistic legal prompts that challenge LLM reasoning
• Clear evaluation rubrics aligned with professional legal standards
• Expert assessments of model performance
• High-quality gold responses suitable for model benchmarking

Qualifications:

• J.D. from an accredited U.S. law school
• Active U.S. law license
• 10+ years of legal practice experience
• Background in BigLaw, Fortune 500 in-house legal, or specialized boutique firms
• Strong analytical writing and legal reasoning skills

• Mid-Senior level
• Contract
• Education and Training
• Software Development

Similar jobs