Legal Expert – AI Model Evaluation & Reasoning
About the Role
A leading AI-focused initiative is seeking experienced legal professionals to support the development and evaluation of advanced AI systems. This opportunity centers on improving legal reasoning capabilities through the assessment of AI-generated responses in realistic workplace and employment-related scenarios.
This opportunity is ideal for legal practitioners with strong backgrounds in employment and labor law, legal research, and legal writing. Candidates who can apply practical legal judgment, identify nuanced issues, and communicate findings clearly will be well positioned for success.
The work involves reviewing AI-generated legal analyses, comparing response quality, and providing structured feedback that contributes to model improvement. Accuracy, analytical rigor, and attention to detail are critical in maintaining high evaluation standards.
What You'll Do
- Evaluate legal reasoning and accuracy of AI-generated responses
- Compare multiple outputs addressing the same legal scenario
- Assess content for correctness, completeness, and professional quality
- Provide detailed written feedback to support model improvement
- Apply legal research and case analysis principles during evaluations
- Review workplace, employment, and labor-related legal scenarios
- Participate in onboarding sessions and calibration activities
- Maintain consistency with project guidelines and quality standards
Requirements
- Minimum 2 years of professional experience in employment or labor law
- Experience within a law firm, corporate legal department, government agency, labor organization, or similar legal environment
- Juris Doctor (J.D.), LL.B., LL.M., or equivalent legal qualification from an accredited institution
- Licensed to practice law in the United States (active or inactive status preferred)
- Strong legal research and legal writing experience
- Demonstrated ability to analyze case law and legal precedents
- Experience drafting legal memoranda, opinions, or advisory documents
- Excellent written communication skills
- High attention to detail and analytical accuracy
- Ability to work independently in a remote setting
- Availability to participate in onboarding and calibration sessions
- Residence in the United States, Canada, or United Kingdom
- Familiarity with AI-assisted review tools and emerging legal technology preferred
- Experience evaluating complex legal arguments and workplace dispute matters preferred
- Ability to commit approximately 6–15 hours per week preferred