Sai Vivek Peddi

About Sai Vivek Peddi

Sr MLE/ AI Researcher with expertise in Large Language Models, Retrieval-Augmented Generation (RAG), and ML systems optimization. Currently leading research on hardware acceleration for LLMs in collaboration with UCD and AMD, while building enterprise-grade AI agents and multi-agent RAG systems.My technical journey spans from implementing distributed systems at JP Morgan Chase to researching transformer architectures. I specialize in- Building production-ready ML systems with PyTorch, TensorFlow, and LangChain- Optimizing ML infrastructure using CUDA, ROCm, and heterogeneous computing- Developing scalable data pipelines with Spark, Kafka, and cloud technologiesI\'m passionate about developing efficient, scalable ML systems that bridge the gap between research and production. My work focuses on optimizing ML infrastructure and building practical AI solutions that deliver real business value.Beyond tech, I find joy in cooking, photography, and cricket. Always eager to connect with fellow ML enthusiasts and researchers!

Experience

1. Co-founder

   Stealth Startup

   Jan 2026 — Present · Palo Alto, CA, US

   Building enterprise agentic AI infrastructure

Education

• University of California, Davis

  Master of Science - MS, Computer Science

• Birla Institute of Technology and Science, Pilani

  Bachelor of Engineering, Electrical, Electronics and Communications Engineering

  2015 — 2019