U.S. Tax Workflow Evaluation Specialist
About the Role
A structured AI evaluation initiative focused on assessing U.S. tax filing workflows and related financial processes. The work involves reviewing realistic tax scenarios and system-generated outputs to identify accuracy, completeness, and usability issues.
This opportunity is ideal for financially literate individuals with hands-on experience preparing or filing U.S. taxes. Candidates should be comfortable reviewing financial documents, applying structured evaluation criteria, and communicating findings with precision.
The work involves annotating tax-related workflows, comparing outputs against source documents and scenarios, and providing written or verbal feedback. Consistency, attention to detail, and adherence to defined evaluation rubrics are critical.
What You'll Do
- Review and evaluate U.S. tax filing workflows and related financial processes
- Apply defined rubrics to assess workflow accuracy, completeness, and user experience
- Compare system-generated outputs against tax documents and realistic financial scenarios
- Review and annotate relevant documents according to project guidelines
- Provide clear written and verbal feedback on identified issues
- Communicate task progress and deliverable status asynchronously
- Follow structured digital workflows for document review and evaluation
- Participate in quality-assurance and rubric-based assessment activities
Requirements
- Currently reside in a mainland U.S. state
- Demonstrated financial literacy
- Hands-on experience filing 2025 U.S. taxes independently or with assistance from a CPA or tax professional
- Strong attention to detail when reviewing and annotating documents
- Ability to consistently apply structured evaluation criteria and rubrics
- Strong written and verbal communication skills
- Familiarity with Google Workspace, including Docs, Sheets, and Drive
- Comfortable following detailed digital workflows and project instructions
- Ability to provide timely updates in an asynchronous work environment
- Familiarity with data annotation, quality review, RLHF, model evaluation, or workflow assessment is preferred
- Experience reviewing tax documents or financial workflows is preferred
- Comfortable using secure, project-specific account connections where required by the workflow is preferred