Ankur Agrawal
Microsoft Azure AI Platform | Author | Mentor | 1% on Topmate | Humor Mill 😊
- Role
- India Engineering Head Azureml Inferencing Team Group Engineering Manager at Microsoft
- Location
- Hyderabad, TG, IN
- LinkedIn followers
- 500 followers
About Ankur Agrawal
With over 26 years of experience in the tech industry, I currently lead the India Engineering team for the Azure AI Inferencing Platform at Microsoft, driving innovation in AI inferencing at scale. My team powers the Azure Managed Online Endpoints, a platform that handles trillions of monthly requests and supports foundational and open-source models like ChatGPT with high throughput and reliability. Previously, I spearheaded engineering for Bing, Copilot, and Microsoft AI Platform India, delivering backend infrastructure with unmatched scale and efficiency for global products like Bing search and Edge browser. Passionate about building resilient cloud systems, I focus on enabling high-performance model hosting and fostering motivated, high-performing teams to advance AI and cloud technologies.
Experience
India Engineering Head Azureml Inferencing Team Group Engineering Manager
Dec 2024 — Present · Hyderabad, IN
Azure Managed Online Endpoints (managed inferencing platform) powers all the models in Azure AI Foundry, both foundation and open source. The inferencing platform serves trillions of monthly requests: a few million requests per second, accounting for 100s of million core hours. This is the next generation of model serving platform that includes hosting OAI models like ChatGPT, hosting models at Bing and Office scale and many exciting problems on the intersection of AI and Cloud. I lead a team which is entrusted for designing and building highly reliable and available platform to support model inferencing at scale and work on high throughput/low latency scenarios and driving performance optimization capabilities.
Education
Birla Institute of Technology and Science, Pilani
Bachelor of Engineering (BEng), Computer Science
1995 — 1999
Skills
- Microsoft Azure
- Windows Azure
- Agile Methodologies
- Distributed Systems
- Software Design
- Switches
- C
- Scalability
- Software Engineering
- Software Development
- Snmp
- Device Drivers
- C#
- Cloud Computing
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.