Fractal

Senior QA (Gen AI - Must have) Exp: 5+ Years

📍 Location
Mumbai, Maharashtra
⏰ Job Type
Full time
📅 Posted
June 09, 2026
Apply Now

Job Description

It's fun to work in a company where people truly BELIEVE in what they are doing!

Role: Senior QA (Gen AI - Must Have)

Experience: 5+ Years

Detailed JD :

  • Design, automate, and execute API test suites (functional, contract, performance, resilience)
  • Define LLM evaluation strategies (performance testing, golden sets, guardrails, hallucination/consistency checks, relevance & latency KPIs); build automated eval pipelines tied to releases.
  • Create PDLM deliverables: verification plans/protocols, test reports, risk-based coverage, V&V trace matrices to requirements and use cases.
  • Integrate test infrastructure with Azure DevOps (CI/CD, test orchestration, quality gates, dashboards); enforce build-time gates for API and LLM quality.
  • Partner with Product, Clinical, and R&D to refine requirements and acceptance criteria; ensure summaries render correctly for different user roles and workflows.
  • What is required f...

    Ready to Apply?

    Take the next step in your career - we're hiring now!

    Apply for this Position