Job Description:
Trigyn has a contractual opportunity for a AI Testing Consultant. This resource will be working Remotely until noon EST.
Job Description:
We are looking for an AI Testing Consultant with hands on experience in AI Agent–based solutions. The resource will be responsible for validating AI agents, testing workflows, and using Microsoft AI Foundry evaluators to measure quality, accuracy, and performance across different AI scenarios.
Key Responsibilities
• Perform testing and validation of AI Agents, including single agent and multi agent workflows.
• Execute functional, non functional, and scenario based testing for AI-driven use cases.
• Use Microsoft AI Foundry evaluators to assess AI performance metrics such as accuracy, relevance, grounding, completeness, and safety.
• Analyze evaluator results and help identify gaps, risks, and improvement areas in AI responses.
• Validate AI outputs against business requirements and expected behaviors.
• Work closely with onshore teams, architects, and developers to support test strategy and defect resolution.
• Document test scenarios, test results, and evaluation findings clearly.
Required Skills & Experience
• 2–3 years of experience in testing or validation roles, preferably in AI, ML, or intelligent automation.
• Hands on experience testing AI agents, chatbots, or GenAI-based applications.
• Good understanding of AI evaluation metrics (e.g., precision, recall, relevance, groundedness, hallucination).
• Exposure to Microsoft AI Foundry evaluators or similar AI evaluation frameworks.
• Understanding of prompt-based systems and agent behaviors.
• Strong analytical skills to interpret AI evaluation results.
• Good communication and documentation skills.
Nice to Have
• Experience with Copilot Studio or agentic AI architectures.
• Familiarity with testing multi-agent or orchestrated AI workflows.
• Experience working in enterprise environments with governance and compliance requirements.
For Immediate Response, please send your Resume to Global-Recruitment@Trigyn.com
TRIGYN TECHNOLOGIES is a multinational IT services company with resources deployed in 28 countries. TRIGYN is an ISO 9001:2015, ISO 27001:2022 (ISMS) and CMMI Level 5 certified company. TRIGYN has offices in the United States, Canada, Switzerland and India.