Charu Jain

About Charu Jain

I work at the intersection of AI quality, program operations and large-scale model evaluation, helping improve customer-facing AI systems across global marketplaces.At Amazon, I partner with program, science, and engineering teams to analyze AI model behavior, identify systemic quality gaps, and drive improvements through data-driven insights and cross-team initiatives.

Experience

1. Process Lead Ai Quality & Llm Evaluation

   Amazon

   Apr 2025 — Present · Delhi, IN

   Led AI response quality improvement programs across 13 global marketplaces, identifying systemic model defects and driving improvements that reduced defect rates from 24% → 11% during launch cycles.• Partnered with science, engineering and program teams to evaluate next-generation AI models prior to launch, conducting large-scale evaluation deep dives to identify quality gaps and inform release readiness.• Led prompt-optimization initiatives for Japanese AI responses, improving text accuracy from 70% → 90.7% and increasing related-question response accuracy from 37% → 50.5%.• Conducted marketplace-level investigations into AI response failures, surfacing evidence-retrieval and ranking gaps impacting customer answers across 13 marketplaces.• Led cross-team root cause investigations for customer-impacting AI response issues across retail and business platforms, driving data and guideline improvements to improve response reliability.• Managed high-severity production issues affecting 300K+ weekly AI interactions, coordinating engineering fixes and mitigation ahead of major retail events.