Senior Legal AI Evaluation Specialist
About the Role
A structured AI evaluation initiative focused on building high-quality legal reasoning tasks for complex enterprise environments. The work reflects the regulatory, transactional, compliance, and risk considerations encountered by large public companies.
This opportunity is ideal for senior legal professionals with substantial experience in-house at large public companies or at major law firms serving enterprise clients. Strong candidates will have deep expertise in at least one relevant legal practice area and the ability to distinguish rigorous legal analysis from superficial responses.
The work involves creating realistic legal scenarios, drafting reference-quality materials, and developing detailed evaluation rubrics. Accuracy, practical legal judgment, and familiarity with enterprise legal and compliance workflows are critical.
What You'll Do
- Construct realistic enterprise legal scenarios across in-house, regulatory, transactional, and litigation matters
- Draft and review materials involving FCPA, SOX, GDPR, HIPAA, and sector-specific regulatory requirements
- Develop contracting scenarios involving MSAs, SOWs, DPAs, licensing, and other material commercial agreements
- Create M&A diligence tasks reflecting large-scale transaction environments
- Develop ERM- and COSO-aligned risk scenarios, board-level reporting exercises, and regulated-industry investigations
- Author criterion-referenced rubrics that evaluate senior-level legal reasoning and judgment
Requirements
- 2+ years of in-house counsel experience at a Fortune 500 or large public company, or partner/senior associate experience at a major law firm representing large enterprise clients
- Deep expertise in one or more areas including M&A, securities, regulatory, employment, intellectual property, privacy, or commercial contracting
- JD and active U.S. bar admission
- Ability to analyze complex legal scenarios and produce precise, defensible written work
- Familiarity with enterprise legal technology or CLM platforms such as Ironclad, Agiloft, or Icertis
- Familiarity with enterprise GRC tooling and risk-management frameworks
- Ability to work remotely with a minimum commitment of 20 hours per week
- Strong legal writing, issue-spotting, and evaluation skills
- Prior experience creating rubrics, examinations, training materials, or other structured evaluation content preferred
- Experience with AI evaluation or legal technology workflows preferred
- United States work eligibility; H-1B and STEM OPT arrangements are not supported