Shivam Tyagi

About Shivam Tyagi

I build AI and machine learning systems that solve real business problems at enterprise…

Experience

1. Advanced Data Science Associate

   ZS

   Jul 2023 — Present · Gurugram, IN

   Drive AI Innovation: Played a key role in designing and deploying innovative Gen AI chatbot solutions for clients, collaborating with seasoned data scientists and multidisciplinary teams to deliver real-world impact.Pioneer LLM-Based Evaluation: Led the design and implementation of advanced evaluation protocols for Gen AI chatbots powered by LLM-based responses. Developed and managed systematic assessment frameworks that leveraged real-world user prompts and diverse case scenarios, extracting rich insights into model accuracy, relevancy, and conversational quality. Collaborated across teams to interpret evaluation data, optimize interactive flows, and ensure that LLM-driven solutions consistently delivered superior user experiences and actionable business outcomes.Advance Workflow Efficiency: Actively contributed to optimizing prompt engineering, integrating functional components, and building dynamic response strategies—helping boost both model efficiency and responsiveness in production settings.Deliver Robust Performance: Worked alongside engineers to meaningfully reduce time-to-first-response (TTFT) to under 5 seconds, and supported efforts to consistently maintain production inference accuracy above 95%, ensuring reliable user experiences.Uphold Quality Excellence: Assisted in establishing automated validation protocols and took part in rigorous (PSR) testing, helping guarantee the scalability, quality, and robustness of deployments.Demonstrate Business Value: Supported the creation of compelling analyses and materials that clearly showcased how Gen AI chatbot solutions drive insights, enhance efficiency in pharma operations, and optimize business outcomes like incentive compensation.