Govind Prabhu
Senior Software Engineer @ Microsoft Core AI | LLM Inference & Routing Architect| Designing Scalable GenAI Systems | LLM Inference & Cost Optimization at Scale
- Role
- Senior Software Engineer at Microsoft
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About Govind Prabhu
As a Senior Software Engineer at Microsoft, I focus on advancing the capabilities of the Azure OpenAI inference platform. With expertise in distributed systems and machine learning, I contribute to developing scalable solutions for deploying and optimizing AI models. My work emphasizes improving AI/ML infrastructure through innovative and efficient methods. Over six years of experience, including roles at Adobe and VMware, have honed my skills in software development, distributed systems, and machine learning. My contributions include designing distributed data processing frameworks, implementing generative model architectures, and creating data preprocessing pipelines that enhance efficiency and reduce costs. I am driven by the pursuit of advancing AI technologies through collaboration and cutting-edge solutions.
Experience
Senior Software Engineer
May 2024 — Present · Bengaluru, IN
LLM Traffic Orchestration∗ Developed high-throughput traffic manager for routing inference requests across distributed model endpoints∗ Increased system throughput by 2x while maintaining P50 latency SLA compliance∗ Implemented intelligent load balancing across logical groups of backend services
Education
College of Engineering Trivandrum
Bachelor of Technology (B.Tech.), Computer Science
Udacity
Nano degree, Deep learning
2018 — 2018
International Institute of Information Technology Bangalore
Postgrad Diploma, Machine Learning And Artificial Intelligence
Liverpool John Moores University
Master's degree, Machine Learning and AI
Udacity
Self Driving Car Nano Degree, Part - 1, Artificial Intelligence
2018 — 2019
Coursera
Specialization, Deep Learning
2018 — 2018
Skills
- Research
- Photoshop
- Cpp
- Teamwork
- English
- Python
- Html
- Event Planning
- Microsoft Word
- Powerpoint
- Microsoft Excel
- Windows
- Social Media
- C++
- Spring Framework
- Public Speaking
- Jerseys
- Java
- Microsoft Office
- Javascript
- Sql
- Hibernate
- C
- Programming
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.