Mandar Vaidya
Senior Business Analyst @Mindsprint ||PGDM 2025 || XIME CHENNAI || Ex - President, X-OPS(Operations Club)
- Role
- Senior Business Analyst at Mindsprint
- Location
- Indore, MP, IN
- LinkedIn followers
- 500 followers
About Mandar Vaidya
Loves to Explore then exploit! Adaptable with experience providing results. Meets job…
Experience
Senior Business Analyst
Apr 2025 — Present · Chennai, IN
Led the design and build of an enterprise-grade GenAI evaluation and TestOps platform, focused on making LLM and agentic systems reliable beyond demosDesigned RAG architectures and investigated real-world failure modes including semantic collapse, retrieval degradation, and hallucination amplification at scaleBuilt end-to-end LLM evaluation pipelines using relevance, faithfulness, coherence, and grounding metrics; moved evaluation from manual review to measurable signalsImplemented observability and experiment tracking for GenAI systems to compare prompts, retrieval strategies, and model behavior across runsWorked hands-on with Azure OpenAI (GPT-4o), DeepEval, Opik, FastAPI, and Streamlit to productionize GenAI testing workflowsPartnered with QA, data, and engineering teams to translate research findings into system architecture decisionsDefined guardrails for safe deployment of GenAI, covering prompt injection, retrieval failures, regression risk, and scale-related breakdownsContributed to internal GenAI capability building, frameworks, demos, and client-facing PoCs
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.