Agentic AI Expert – Technical Workflow Evaluation
About the Role
A leading AI-focused initiative is seeking experienced technical professionals to support the advancement of agentic AI systems in software engineering environments. This opportunity focuses on improving how AI agents plan, execute, and reason through complex technical workflows using real-world development scenarios.
This opportunity is ideal for individuals with strong software engineering, automation, DevOps, data science, or machine learning backgrounds who have experience working alongside AI-powered development tools. Success requires the ability to evaluate technical outputs critically, communicate findings clearly, and apply structured problem-solving approaches.
The work involves collaborating with autonomous AI coding agents, assessing generated solutions, and documenting workflow effectiveness across a range of technical tasks. Attention to detail, analytical thinking, and strong technical communication are essential for producing reliable evaluations and actionable insights.
What You'll Do
- Execute complex technical workflows using AI-powered coding agents
- Plan, develop, debug, and refactor software solutions in collaboration with AI systems
- Evaluate AI-generated code for correctness, efficiency, and maintainability
- Identify errors, inconsistencies, hallucinations, and performance limitations
- Compare outputs from multiple AI tools and document evaluation results
- Provide detailed feedback on reasoning quality and coding effectiveness
- Create documentation outlining best practices for AI-assisted development workflows
- Assess agentic development environments and automation platforms
- Record observations, findings, and recommendations in a structured format
- Participate in practical exercises involving AI-assisted technical problem solving
Requirements
- Professional experience in software engineering, DevOps, data science, machine learning engineering, technical automation, or related fields
- Strong understanding of software development principles and code quality standards
- Experience working with AI coding assistants or autonomous development tools
- Ability to delegate multi-step technical tasks to AI systems and refine outputs iteratively
- Knowledge of prompt engineering and AI collaboration workflows
- Experience evaluating AI-generated code and technical solutions
- Strong debugging, troubleshooting, and code refactoring skills
- Ability to assess reasoning quality across different AI-generated outputs
- Excellent written communication skills for technical documentation
- Strong verbal communication and collaboration abilities
- High attention to detail and analytical thinking
- Ability to work independently in a remote environment
- Familiarity with agentic development platforms and AI coding tools preferred
- Experience using tools such as GitHub Copilot, Codex, Claude Code, Cursor, Gemini CLI, or similar solutions preferred
- Experience conducting technical evaluations, experiments, or comparative tool assessments preferred
- Background in automation, workflow optimization, or AI-assisted software development preferred