Film & Video Quality Evaluation Specialist
About the Role
A high-impact AI research initiative focused on evaluating and improving next-generation video generation models. The opportunity involves applying professional film, theater, animation, and post-production expertise to assess AI-generated video outputs across cinematography, lighting, composition, visual effects, continuity, texture, and performance.
This opportunity is ideal for experienced film and theater professionals, cinematographers, camera operators, editors, colorists, VFX specialists, animation professionals, and performance experts with a trained visual eye and the ability to communicate detailed creative judgments.
The work involves comparing AI-generated video sequences, assessing their technical and artistic quality, validating outputs against creative prompts, and providing structured evaluation feedback. Consistency, professional judgment, attention to detail, and clear written communication are critical.
What You'll Do
- Evaluate pairs of AI-generated videos against defined professional quality criteria.
- Compare lighting, color grading, framing, composition, and camera movement.
- Assess lens direction, visual texture, physical realism, and shot continuity.
- Review acting quality, character movement, and dialogue delivery.
- Verify whether generated videos accurately follow specified prompts and creative instructions.
- Identify visual inconsistencies, technical defects, and performance-related weaknesses.
- Write concise, evidence-based explanations supporting evaluation decisions.
- Participate in calibration exercises to maintain consistent evaluation standards.
- Identify unclear evaluation guidelines and recommend improvements.
- Collaborate with other subject matter experts to improve evaluation accuracy.
Requirements
- Professional or graduate-level experience in at least one relevant discipline, including film production, theater, cinematography, editing, animation, visual effects, compositing, lighting, color grading, directing, acting, or camera operations.
- Either formal training from a recognized film, theater, or animation program combined with at least 2 years of practical experience, or at least 4 years of relevant professional experience.
- For candidates qualifying through practical experience, involvement in at least two projects with theatrical releases.
- Strong understanding of cinematography, visual storytelling, shot composition, lighting, and post-production workflows.
- Ability to identify subtle visual and technical differences between video sequences.
- Strong written English communication skills.
- Ability to explain creative and technical judgments using precise, professional terminology.
- Reliable availability for at least 20 hours per week during weekdays.
- Access to a high-quality display and headphones for video and dialogue evaluation.
- Ability to work independently in a fully remote environment.
- Proficiency in at least one additional dubbing language, such as French, Italian, German, Spanish, Portuguese, Korean, or Hindi, is preferred.
- Experience with professional film production workflows, digital imaging, color management, or visual quality assurance is preferred.