Phani Bhushan Kolla

About Phani Bhushan Kolla

Currently serving as a Senior Data Scientist at Elevance Health, contributing expertise in developing and deploying LLM-based solutions and custom GPT models. Proficient in leveraging tools like Langraph, FastAPI, and Pyspark, alongside strengths in cross-team collaboration and API development. At Elevance Health, contributed to transformative projects such as deploying agentic chatbots and fine-tuning GPT models for clinical applications. Collaborated with teams to enhance machine learning pipelines and improve classification tasks using innovative embedding techniques. Motivated to drive impactful solutions in healthcare analytics, bringing a balance of technical acumen and collaborative spirit.

Experience

1. Senior Ai Engineer

   Elevance Health

   May 2023 — Present

   Building Eval as a Service for AI applications across the enterprise- Lead the development and deployment efforts for LLM Leaderboard on Elevance Health specific data, evaluating various open source and proprietary LLMS with metrics like BLEU, ROUGE, Hallucination etc- Develop custom LLM evaluation metrics for Clinical use-cases- Designed, built, and deployed an agentic chatbot using Langraph that can answer queries from live web data and vector database. Created an API endpoint through a FastAPI and deployed it on AWS. Utilized Mutli agnet pattern to implement gaurdrails, segregate the tasks which greatly improved the performance- Deployed Fine tuning as a service on Custom GPT model, using Huggingface, PyTorch, FastAPI- Infer custom-built GPT model trained on Clinical Codes using Pytorch and Huggingface and evaluate performance of GPT model on tasks like Zero-Shot Prediction, Generating Synthetic Data and metrics like Fidelity, Perplexity etc- Developed Python SDK used across the Enterprise for measuring various metrics like Data Drift, BIAS detection etc, utilizing Gherkin, Pytest for Feature testing and Unit testing- Deployed scalable APIs serving various NLP solutions using Knative on AWS.

Education

• University of South Florida Muma College of Business

  Master of Science - MS, Artificial Intelligence and Business Analytics

Skills

• Matlab
• Sql
• Agile Methodologies
• Windows Presentation Foundation (Wpf)
• Management
• English
• C
• Programming
• Teamwork
• Photoshop
• Testing
• Electrical Engineering
• Digital Photography
• Java
• Microsoft Word
• Engineering
• Powerpoint
• Microsoft Excel
• Adobe Photoshop
• Research
• Web Development
• C++
• Itil
• Model-View-Viewmodel (Mvvm)
• C#
• Microsoft Office
• Soft Skills
• Customer Service