Sumi Somangili

About Sumi Somangili

Senior Engineering Leader specializing in Generative AI, focused on building and guiding elite teams that ship transformative, production-ready AI applications. I bridge the gap between pioneering research in Large Language Models (LLMs) and scalable, reliable engineering, translating cutting-edge capabilities into measurable business value.I lead the full lifecycle of Generative AI products—from strategic conception and rapid prototyping to robust production deployment and iterative improvement. My expertise is in architecting systems around LLMs, Multi-Agent workflows, and Advanced RAG, while ensuring engineering excellence, operational reliability, and clear ROI.My Generative AI Leadership Stack:Team Building for the AI Era: Hiring, mentoring, and leading high-caliber teams of Prompt Engineers, LLM Application Developers, and MLOps Engineers. Fostering a culture of innovation, rapid iteration, and responsible AI development.Strategic Roadmap & Execution: Partnering with product and executive leadership to define the Generative AI vision, prioritize use cases (e.g, AI Copilots, Content Generation, Complex Automation), and deliver scalable solutions aligned with business goals.Full-Stack Generative AI Architecture: Hands-on experience designing and overseeing the build of:Sophisticated RAG Pipelines with advanced chunking, hybrid search, and re-ranking for enterprise knowledge bases.Multi-Agent & Agentic AI Systems for complex task automation and reasoning.LLM Application Frameworks leveraging LangChain/LlamaIndex, with integrations via protocols like Model Context Protocol (MCP).Production MLOps for AI: Scalable inference, evaluation frameworks, monitoring, cost optimization, and governance for LLMs.Cross-Functional Catalyst: Effectively aligning engineering efforts with UX, legal, security, and business teams to navigate the unique challenges of deploying Generative AI safely and effectively.Technical Foundation & Impact: I am deeply versed in the modern Generative AI stack: from OpenAI, Anthropic, and open-source LLMs to vector databases, fine-tuning techniques (LoRA, QLoRA), and cloud AI platforms. I\'ve architected solutions in domains including AI-powered search, dynamic content generation, code generation assistants, and autonomous workflow automation.I am passionate about building the next generation of AI-native products and am open to connecting with visionary leaders and about opportunities to pioneer Generative AI initiatives.#GenerativeAI #AIEngineeringManager#TechRecruiting

Experience

1. Sr Engineering Manager Architect (Ai Ml & Generative Ai Focus)

   Grady Health System

   Apr 2025 — Present

   Generative AI Engineering Manager | LLM, Agentic AI & RAGI lead the Generative AI Applications team at Grady Health System, building and mentoring high-performance teams that ship production-grade AI applications—specializing in LLM orchestration, agentic workflows, and intelligent automation for healthcare.We architect enterprise-scale Generative AI solutions (multi-agent systems, advanced RAG, conversational AI) integrated with FHIR-enabled clinical data and Epic EHR. My role spans full-stack AI leadership: product strategy, technical architecture, team development, and deployment of reliable, compliant systems.Key Leadership & Technical Achievements:Team Building for GenAI: Hire, mentor, and lead Generative AI Engineers, LLM Application Developers, and Backend Engineers specializing in AI integration, orchestration, and prompt engineering. Foster a culture of rapid prototyping and production excellence.GenAI Product Strategy & Delivery: Own end-to-end delivery of Generative AI products, from use-case prioritization to scalable deployment. Successfully shipped AI chatbots, workflow automation agents, and knowledge retrieval copilots integrated into healthcare systems.Architecture for AI Applications: Design scalable AI application stacks using LangChain/LlamaIndex and protocols like Model Context Protocol (MCP). Implement orchestration layers, semantic search pipelines with vector databases, and LLM gateway/observability systems.Cross-Functional AI Integration: Partner with product, clinical teams, and IT to embed Generative AI capabilities safely into user workflows. Bridge cutting-edge AI potential with secure, user-centric implementation.Technical Innovation: Champion the modern GenAI stack—AI agent frameworks, advanced prompt chaining, LLM caching & optimization, and evaluation frameworks for conversational AI—to build next-generation intelligent healthcare tools.

Education

• Madurai Kamaraj University (MKU)

  Bachelor of Engineering - BE(Honors)