Project Overview

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking a skilled Finance, Legal & Compliance Specialist to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.

Location: U.S.-based experts only

Engagement: Part-time, project-based expert evaluation work

Work Type: Remote

Project Summary

This project supports the development of an AI benchmarking framework designed to measure how effectively artificial intelligence models perform real-world, economically valuable knowledge work. The benchmark evaluates AI systems against tasks commonly performed by finance, legal, risk, governance, regulatory, and compliance professionals in business environments.

Contributors will create expert benchmark outputs, define evaluation criteria, and assess AI-generated work products across a range of professional scenarios. Example tasks may include regulatory interpretation, policy review, contract analysis, compliance risk assessment, financial analysis, internal controls evaluation, governance documentation, due diligence, and professional decision-making exercises. The goal is to establish rigorous, expert-driven standards for measuring AI performance on complex business and regulatory workflows.

Consultant Engagement Terms

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).

Responsibilities

Contributors will:

• Create expert benchmark responses for finance, legal, and compliance-related business scenarios
• Develop scoring rubrics that define high-quality professional work products and decision-making standards
• Evaluate AI-generated analyses, recommendations, and written deliverables against established benchmarks
• Assess the accuracy, completeness, reasoning quality, and practical applicability of AI outputs
• Review AI-generated work involving financial analysis, regulatory requirements, governance processes, compliance obligations, and legal documentation
• Identify factual errors, compliance risks, flawed reasoning, unsupported conclusions, and material omissions
• Apply professional judgment to determine whether outputs meet real-world business standards
• Provide written rationale supporting evaluation decisions and scoring outcomes
• Participate in calibration exercises and quality review activities when required

Expected Outcomes

• High-quality benchmark answers reflecting professional finance, legal, and compliance practices
• Clear, defensible evaluation rubrics aligned with real-world business requirements
• Consistent and reliable assessment of AI-generated work products
• Identification of strengths, weaknesses, and risk areas in model performance
• Expert evaluations that support rigorous benchmarking of AI systems on economically valuable knowledge work
• Documentation that enables repeatable and scalable model evaluation

Qualifications

• Minimum 3+ years of professional experience in one or more of the following areas:
• Corporate Finance
• Financial Planning & Analysis (FP&A)
• Accounting
• Internal Audit
• Risk Management
• Regulatory Compliance
• Corporate Governance
• Legal Operations
• Corporate Counsel
• Financial Services Compliance
• Banking Compliance
• Regulatory Affairs
• Strong understanding of regulatory frameworks, business controls, governance processes, or legal and financial risk management
• Experience reviewing, interpreting, or applying laws, regulations, policies, contracts, standards, or financial documentation
• Ability to analyze complex business scenarios and articulate professional reasoning clearly in writing
• Experience creating, reviewing, or evaluating professional work products such as policies, procedures, contracts, risk assessments, audit findings, compliance reviews, or financial analyses
• Strong attention to detail and ability to identify inaccuracies, omissions, and compliance risks
• Professional certifications are preferred where applicable (e.g., CPA, CFA, CAMS, CRCM, CISA, CIA, JD, Bar Admission, Certified Compliance & Ethics Professional (CCEP), or equivalent)
• U.S.-based