Kodanda Harshavardhan Alla

About Kodanda Harshavardhan Alla

GenAI Engineer | ML & LLMs | AWS + Azure | Full-Stack AI Solutions I design and…

Experience

1. Gen Ai Engineer

   State Farm

   Jan 2025 — Present

   Designed and deployed Generative AI applications using OpenAI GPT-4 and Hugging Face Transformers integrated with LangChain for advanced prompt engineering and retrieval-augmented generation (RAG). Built scalable, secure LLM-powered workflows on AWS SageMaker for model training, fine-tuning, and endpoint deployment tailored to enterprise use cases. Developed RAG pipelines utilizing Amazon OpenSearch, Amazon S3, and FAISS for vector similarity search, enabling context-rich responses from private datasets. Created full-stack applications with React.js frontend and FastAPI/Python backend, integrating AWS services such as AWS Lambda, API Gateway, DynamoDB, and RDS (PostgreSQL) for storage and serverless orchestration. Engineered serverless LLM inference workflows with AWS Step Functions and AWS Lambda, orchestrating multi-agent tasks with LangChain tool usage. Containerized GenAI microservices using Docker and deployed on Amazon EKS (Elastic Kubernetes Service) with CI/CD pipelines via AWS CodePipeline and GitHub Actions. Integrated AWS Cognito for secure user authentication and authorization across GenAI applications, ensuring multi-tenant and role-based access. Leveraged AWS Textract and Amazon Comprehend to extract and analyze data from scanned documents and unstructured text, feeding into GPT-4 workflows for enhanced summarization and question answering. Built real-time, interactive chatbot interfaces with streaming GPT responses using WebSockets and React, delivering superior user experience. Implemented enterprise-grade security and compliance by managing secrets with AWS Secrets Manager and monitoring application health with AWS CloudWatch and X-Ray.