Harshith Vemula

About Harshith Vemula

Hi, I am Harshith Vemula I am an AI/ML Engineer and Data Engineer with hands-on…

Experience

1. Ai & Ml Engineer

   Databricks

   Aug 2025 — Present · US

   Led the end-to-end development of an enterprise-grade Retrieval-Augmented Generation (RAG) platform designed to process over 1.2 million financial and compliance documents. This system enabled auditors to extract insights in real time with significantly higher accuracy, improving information precision and audit traceability by 18%. Responsibilities included designing ingestion flows, vectorization pipelines, document chunking strategies, and retrieval orchestration to ensure enterprise-level performance and reliability.Architected advanced retrieval, reasoning, and model intelligence pipelines using LangChain, integrating tools, agents, and custom prompt optimization layers. Fine-tuned multiple transformer-based LLMs - including BERT, Falcon, and GPT-Neo - using Hugging Face to enhance semantic understanding. Achieved a 21% improvement in contextual query accuracy and delivered sub-100ms inference latency by optimizing model serving and request handling via FastAPI.Built a complete, production-grade MLOps ecosystem leveraging AWS SageMaker, MLflow, Docker, and Kubernetes (EKS). Designed automated pipelines for training, validation, hyperparameter tuning, experiment tracking, model versioning, and reproducible deployments. This automation reduced manual retraining and maintenance effort by 40% while ensuring consistent, scalable, and audit-friendly ML operations.Implemented enterprise CI/CD workflows using GitHub Actions and Jenkins, enabling version-controlled retraining, automated testing, and zero-downtime model rollouts. Integrated real-time drift monitoring using MLflow and CloudWatch to proactively detect performance degradation. These enhancements reduced model release cycles from several weeks to a few days, significantly improving production reliability and compliance readiness for high-stakes financial environments.