Finance Expert — AI Model Evaluation
About the Role
A structured AI initiative is seeking finance expertise to evaluate and improve the performance of advanced language models across complex financial use cases. The work applies practical domain knowledge to areas where AI systems require stronger reasoning, analysis, and accuracy.
This opportunity is ideal for finance professionals with 2+ years of experience in areas such as capital markets, portfolio management, investment research, trading, quantitative finance, investment banking, private equity, venture capital, FP&A, accounting, or financial consulting. Prior AI experience is not required.
The work involves evaluating model outputs, developing assessment criteria, and collaborating in structured research activities to improve AI training and benchmarking. Strong financial judgment, critical thinking, problem solving, and precise written communication are essential.
What You'll Do
- Evaluate AI model performance across financial scenarios within your area of expertise
- Identify weaknesses, inaccuracies, and reasoning gaps in model outputs
- Develop structured rubrics for assessing financial analysis and domain-specific capabilities
- Create and evaluate scenarios involving investment analysis, forecasting, deal analysis, M&A, risk, or other relevant financial applications
- Collaborate with AI researchers and finance specialists to refine evaluation methodologies
- Provide detailed written feedback to improve model reasoning, accuracy, and reliability
- Contribute to training methods, benchmarks, and evaluation frameworks for finance-focused AI systems
Requirements
- + years of professional experience in capital markets, portfolio management, investment research, trading, quantitative finance, investment banking, private equity, venture capital, growth equity, FP&A, accounting, or financial consulting
- Strong understanding of financial concepts relevant to your area of specialization
- Ability to analyze complex financial problems and identify logical or quantitative errors
- Strong critical-thinking and problem-solving skills
- Excellent written English communication
- Ability to evaluate financial scenarios objectively using structured criteria
- Comfort working remotely on flexible, project-based assignments
- Preferred: CFA Level I, II, or III qualification
- Preferred: CA, CPA, MBA in Finance, or comparable finance qualification
- Preferred: Experience with AI systems, LLM evaluation, financial modeling, or data-driven research