AI Scenario Designer (Training & Evaluation)
About the Role
A high-impact AI training initiative is focused on improving the reasoning and decision-making capabilities of advanced AI agents through realistic, scenario-based simulations. This work centers on constructing complex digital environments and evaluating how AI systems respond to real-world challenges.
This opportunity is ideal for individuals who combine strong writing ability with analytical thinking and creativity. It suits those who can design nuanced situations, identify inconsistencies, and structure information in a way that meaningfully tests AI performance.
The work involves building detailed personas, simulating multi-platform workflows, and creating tasks that require prioritization and judgment. Success depends on clarity, precision, and the ability to model realistic digital interactions across tools and contexts.
What You'll Do
- Design detailed personas and realistic digital environments across platforms such as email, messaging, calendars, and file systems
- Create structured scenarios that test reasoning, prioritization, and decision-making in AI systems
- Execute simulations by running AI agents through designed scenarios and capturing outcomes
- Evaluate AI performance and provide structured guidance to improve results
- Document scenarios, results, and feedback using structured tools and databases
- Identify logical inconsistencies and refine scenario quality for accuracy and realism
- Manage independent workflows and maintain consistent output quality
Requirements
- Undergraduate degree and at least 2 years of professional experience
- Strong written communication skills with high attention to detail
- יכולת to think creatively and construct layered, realistic scenarios
- Comfort working with structured tools such as JSON editors, Airtable, or similar systems
- Ability to critically evaluate information quality and detect inconsistencies
- Self-directed work style with strong time management
- Experience in writing, editing, or content creation (e.g., copywriting, UX writing, journalism) preferred
- Background in coordination roles (e.g., project management, client success, event coordination) preferred
- Exposure to simulation design, game design, or structured scenario creation preferred
- Familiarity with technical tools or data workflows (e.g., JSON, SQL, Python, task management systems) preferred