Phani Bhushan Kolla
Senior Ai Engineer @Elevance Health
Signup · Get unlimited contacts
WORK HISTORY
Senior Ai Engineer @Elevance Health
Building Eval as a Service for AI applications across the enterprise- Lead the development and deployment efforts for LLM Leaderboard on Elevance Health specific data, evaluating various open source and proprietary LLMS with metrics like BLEU, ROUGE, Hallucination etc- Develop custom LLM evaluation metrics for Clinical use-cases- Designed, built, and deployed an agentic chatbot using Langraph that can answer queries from live web data and vector database. Created an API endpoint through a FastAPI and deployed it on AWS. Utilized Mutli agnet pattern to implement gaurdrails, segregate the tasks which greatly improved the performance- Deployed Fine tuning as a service on Custom GPT model, using Huggingface, PyTorch, FastAPI- Infer custom-built GPT model trained on Clinical Codes using Pytorch and Huggingface and evaluate performance of GPT model on tasks like Zero-Shot Prediction, Generating Synthetic Data and metrics like Fidelity, Perplexity etc- Developed Python SDK used across the Enterprise for measuring various metrics like Data Drift, BIAS detection etc, utilizing Gherkin, Pytest for Feature testing and Unit testing- Deployed scalable APIs serving various NLP solutions using Knative on AWS.
EDUCATION
University of South Florida Muma College of Business
Master of Science - MS, Artificial Intelligence and Business Analytics
SKILLS
ABOUT PHANI BHUSHAN KOLLA
Currently serving as a Senior Data Scientist at Elevance Health, contributing expertise in developing and deploying LLM-based solutions and custom GPT models. Proficient in leveraging tools like Langraph, FastAPI, and Pyspark, alongside strengths in cross-team collaboration and API development. At Elevance Health, contributed to transformative projects such as deploying agentic chatbots and fine-tuning GPT models for clinical applications. Collaborated with teams to enhance machine learning pipelines and improve classification tasks using innovative embedding techniques. Motivated to drive impactful solutions in healthcare analytics, bringing a balance of technical acumen and collaborative spirit.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.