AI Training Scenario Designer
About the Role
A large-scale AI training initiative is seeking detail-oriented professionals to design and evaluate realistic digital interaction scenarios for advanced AI systems. The work focuses on building complex environments that test reasoning, prioritization, communication handling, and decision-making under dynamic conditions.
This opportunity is ideal for individuals who combine strong writing ability with structured thinking and operational awareness. Candidates with experience in content creation, project coordination, simulation design, research, or workflow management may be especially well suited to creating high-quality training environments.
The work involves building simulated ecosystems across productivity and communication platforms, designing layered tasks with competing priorities, evaluating AI agent performance, and documenting outcomes in structured systems where clarity and consistency are critical.
What You'll Do
- Design realistic personas and multi-layered digital workflow environments
- Create AI evaluation tasks involving prioritization, scheduling, communication, and information management
- Develop structured prompts and challenge scenarios for AI reasoning systems
- Test AI agents within simulated environments and assess behavioral performance
- Identify reasoning gaps, inconsistencies, and workflow failures in AI outputs
- Provide structured guidance and iterative feedback to improve agent outcomes
- Document scenarios, evaluations, and results using structured operational tools
- Maintain high-quality written documentation and organized datasets
- Collaborate within distributed project workflows while independently managing deliverables
Requirements
- Undergraduate degree required
- Minimum 2 years of professional experience
- Strong written communication and editing ability
- High attention to detail and information accuracy
- Ability to think critically and identify inconsistencies
- Comfort working independently in remote environments
- Experience using structured productivity or project management tools
- Familiarity with digital collaboration environments and workflow systems
- Ability to design realistic operational or communication-based scenarios
- Comfort using AI tools and structured data environments
- Experience with JSON editors, Airtable, or similar systems preferred
- Background in copywriting, UX writing, journalism, editing, or content strategy preferred
- Experience in project coordination, consulting, client operations, or stakeholder management preferred
- Exposure to simulation design, curriculum design, UX research, or world-building preferred
- Familiarity with SQL, Python, Jira, Asana, or technical workflow tooling is a plus
- Ability to manage flexible contract-based workloads and deadlines independently