Sudheer Reddy Koki

About Sudheer Reddy Koki

I am a Senior AI/ML Engineer with 5+ years of hands-on experience building and shipping machine learning and Generative AI systems in production environments.My work sits at the intersection of large language models, real-world engineering, and measurable business outcomes. At MetLife, I lead the design and deployment of RAG pipelines, LLM fine-tuning workflows, and agentic AI systems that serve compliance and operations teams across the enterprise. The results have been concrete — a 34% improvement in document Q&A accuracy, a 33% reduction in inference latency, and a 40% reduction in ML release cycles through end-to-end MLOps automation.Before MetLife, I spent over three years at Cybage Software building NLP systems, distributed training pipelines, and scalable model serving infrastructure for enterprise clients across multiple industries.What I bring to every role— Deep technical expertise across the full ML lifecycle, from data engineering and model development through production deployment, monitoring, and continuous improvement— Hands-on experience with modern Generative AI tooling including LangChain, LangGraph, HuggingFace, OpenAI API, and vector databases such as Pinecone, Chroma, and FAISS— Strong MLOps and LLMOps practices using MLflow, Weights & Biases, GitHub Actions CI/CD, Grafana, Prometheus, and Arize AI— Cloud fluency across AWS (SageMaker), Azure (AML, Databricks), and GCP (Vertex AI), with GPU inference optimization using CUDA, vLLM, and TensorRT— A genuine commitment to responsible AI, model governance, and compliance in regulated environmentsI also maintain open-source projects on GitHub that mirror the production systems I build at work:→ Enterprise RAG Chatbot — github.com/sudheer77-cloud/enterprise-rag-chatbot→ Enterprise Agentic AI Workflow — github.com/sudheer77-cloud/Enterprise-agentic-aiI hold certifications from AWS, Google, Microsoft, and NVIDIA, and recently completed my Master\'s in Information Technology from Cumberland University.I am currently open to Senior AI/ML Engineer, Staff ML Engineer, GenAI Engineer, LLM Engineer, and MLOps Engineer rolesFeel free to reach out directly at s••••••••@gmail.com or connect here on LinkedIn.

Experience

1. Ai Ml Engineer

   MetLife

   Mar 2025 — Present · NY, US

   Metlife-MetLife is one of the world\'s largest insurance and financial services companies, operating in more than 40 countries and serving over 100 million customers globally. The organization leverages advanced data science and AI to drive compliance automation, risk management, operational efficiency, and customer experience across its enterprise platforms. My Responsibilities-At MetLife, I work on enterprise Generative AI systems that are used daily by compliance and operations teams across the organization.My core focus is designing and deploying RAG pipelines, fine-tuning large language models using LoRA and PEFT, and building agentic AI workflows with LangGraph and AutoGen. These systems improved document Q&A accuracy by 34% and reduced inference latency by 33% through GPU-optimized deployments using CUDA, vLLM, and FP16 quantization.On the infrastructure side, I own our end-to-end MLOps and LLMOps pipelines — CI/CD automation with GitHub Actions, experiment tracking in MLflow and Weights & Biases, drift detection, and real-time dashboards in Grafana, Prometheus, and Arize AI. This work cut our ML release cycles by 40% and significantly improved production stability.I also design and maintain our ML data pipelines for both batch and streaming ingestion, integrating AI services with enterprise data warehouses and REST APIs — increasing model-ready data availability by 38%.Beyond the technical work, I lead code reviews, establish reproducible experiment protocols, author design documents, and collaborate cross-functionally with product, analytics, and engineering teams through Agile delivery. Responsible AI principles including fairness assessments, privacy-preserving data handling, bias auditing, and safety filtering are built into our development process from the ground up.

Education

• Cumberland University

  Masters, Information Technology

• St. Ann's College of Engineering and Technology., Nayunipalli(V), Vetapalem(M), Chirala-523187,(CC-F0)

  Bachelor of Technology - BTech, Electronics and Communications Engineering