Sumit Jha

About Sumit Jha

As a Senior Software Engineer at Microsoft Azure, I architect intelligent platforms that transform how cloud infrastructure is optimized, understood, and evolved. With over a decade of experience in designing scalable, cloud-native solutions, I lead cross-functional initiatives that unify data, drive automation, and unlock business value. I lead the development of the Workload Review Platform, a strategic system that delivers actionable recommendations to help customers optimize their Azure deployments. By integrating insights across services, this platform empowers data-driven decisions and scalable improvements — directly impacting customer efficiency and cloud ROI. Previously, I built the Customer Dimensions Platform, a foundational system that standardizes customer, workload, and program definitions across Azure. This platform is leveraged by hundreds of teams to generate insights on consumption, revenue, support, and incident trends — enabling better forecasting, targeting, and service delivery.🤖 At the frontier of AI, I lead initiatives that bring agentic intelligence into enterprise systems. From building a RAG-based search engine using Azure OpenAI and Cognitive Search to developing multi-agent frameworks that automate test generation across APIs, I’m driving the next wave of intelligent automation.My passion lies in agentic AI — systems that reason, collaborate, and act autonomously. I’m currently developing a framework integrated with MCP to bring distributed intelligence into real-world applications, redefining how users interact with data and systems.I thrive at the intersection of technical excellence, strategic vision, and business impact — and I’m always looking to connect with innovators, builders, and leaders shaping the future of cloud and AI.

Experience

1. Senior Software Engineer

   Microsoft

   Dec 2022 — Present · Redmond, WA, US

   AI-Powered Engineering Initiatives • RAG‑Based Incident Mitigation (AI‑Driven Ops)Built a RAG system that analyzes millions of incidents using vector embeddings to find similar historical incidents and recommend proven mitigation steps—significantly accelerating resolution time and improving operational efficiency. • AI Multi‑Agentic Assistant (Autogen‑Powered)Developed an AI multi‑agent framework using Microsoft Autogen to orchestrate specialized agents that retrieve, analyze, and synthesize cross‑domain data, delivering automated, high‑value insights and stronger decision support • RAG‑Based Recommendation SearchDesigned and deployed a RAG‑powered recommendation engine using GPT‑4o and Azure OpenAI embeddings to improve workload discoverability and semantic relevance across Azure services, enabling faster and more accurate solution identification for users. Managed Resiliency Platform • Led the architecture and development of a scalable platform used by Azure customers and Cloud Solution Architects to analyze infrastructure and receive unified, actionable recommendations for improving their resiliency. • Drove cross-organizational collaboration to define end-to-end workload review workflows, service contracts, and SLAs. • Unified insights from multiple Microsoft services, streamlining customer experience and accelerating recommendation delivery. Platform Capabilities • Designed scalable review & recommendation engines supporting thousands of reviews and hundreds of thousands of recommendations across Azure workloads. It also includes Workload Management to managed large-scale workloads of Azure resources. • Delivered actionable insights by analyzing resilience and performance metrics across services. • Integrated and customized recommendations from multiple Azure products for seamless adoption. • Built an observability platform to monitor and visualize all key metrics for proactive issue detection.

Education

• Delhi Public School - Bokaro

  10+2, PCM

  2005 — 2007

• North Carolina State University

  Master’s Degree, Computer Systems Networking and Telecommunications

  2015 — 2016

• NIT JAMSHEDPUR

  Bachelor of Technology (B.Tech.), Electrical, Electronics and Communications Engineering

  2008 — 2012