Manish O.

About Manish O.

AI Architect and Engineering Leader driving enterprise-scale AI platforms with expertise in LLMs, SLMs, multimodal AI, and speech technologies (ASR, TTS, Voice Biometrics). Proven track record in designing and scaling carrier-grade, low-latency inference systems, multi-tenant SaaS architectures, and AI-native contact center platforms serving millions globally. Experienced in MLOps, observability, and responsible AI with a focus on compliance, resilience, and backward compatibility. Passionate about advancing real-time NLP, autonomous agents, and multimodal AI applications to deliver personalized, intelligent, and secure customer experiences at scale.

Experience

1. Partner Software Engineering Leader, Business & Industry Copilot, D365 Contact Center

   Microsoft

   Jun 2022 — Present · Redmond, WA, US

   Driving the architecture and deployment of enterprise-scale AI platforms, spanning Large and Small Language Models (LLMs/SLMs), multimodal AI (speech, text, vision), and real-time inference systems. Lead global engineering and research teams delivering AI-native solutions across speech AI (ASR, TTS, Voice Biometrics), conversational AI, and autonomous agent frameworks.Expertise in building carrier-grade, low-latency systems: designed and scaled multi-tenant runtime inference pipelines, Scalable AI Memory, and hybrid cloud/edge AI infrastructure serving hundreds of millions of interactions monthly. Proven track record of backward compatibility engineering, high availability, and compliance-first architectures for mission-critical platforms.Technical leadership across MLOps, observability, and governance: model evaluation (offline/online Evals, RLHF, LoRA, distillation), AI observability (Prometheus, Grafana, OpenTelemetry), and responsible AI practices (privacy, fairness, audit logging). Extensive experience in cloud-native AI (Azure, Kubernetes, serverless container apps, distributed data systems), API ecosystems (REST, gRPC, GraphQL), and security-driven architectures (RBAC, zero-trust, data masking).Focused on next-generation AI capabilities: streaming LLMs for real-time summarization and translation, multimodal reasoning, autonomous agent orchestration (AutoGen, MCP, CrewAI), and AI-native SaaS platforms that combine scalability, resilience, and personalization to transform customer experiences across industries.

Education

• Nagpur University

  Master's degree, Computer Science

• Andhra University

  Bachelor of Science (BSc), Computer Science

Skills

• Object Oriented Design
• Software Project Management
• Asp.net Mvc
• Sql
• Asp.net
• Ssrs
• Wcf
• Javascript
• Msn Adcenter
• Web Development
• Ado.net
• Testing
• Sdlc
• Xslt
• Soa
• Software Design
• Scalability
• Software Engineering
• Cloud Computing
• Microsoft Sql Server
• Linq
• Sql Server 2000-2008
• Asp.net Ajax
• T-Sql
• Jquery
• Web Applications
• Wpf
• Web Services Api
• Advertising
• C#
• .net
• Oop
• Multithreading
• Distributed Systems
• Agile
• Design Patterns
• Agile Methodologies
• Visual Studio
• Xml
• Rest