Prathima D

About Prathima D

Senior Data Engineer with 11+ years of experience designing scalable data platforms, AI-driven pipelines, and enterprise analytics solutions across Azure, AWS, and GCP. I specialize in building modern data lakehouse architectures using Databricks, Spark, Snowflake, Kafka, and Delta Lake to support real-time analytics, machine learning, and business intelligence. My experience spans end-to-end pipeline development including ingestion, transformation, modeling, orchestration, and deployment of high-performance distributed data systems. In recent projects, I have focused on AI engineering and LLM-powered applications, implementing Retrieval-Augmented Generation (RAG) pipelines, vector search architectures, and intelligent APIs using Python, FastAPI, and OpenAI technologies. I have hands-on experience designing document ingestion frameworks, embedding strategies, semantic search optimization, and human-in-the-loop feedback pipelines to improve model accuracy and reliability.

Experience

1. Azure Data Engineer

   Molina Healthcare

   Nov 2024 — Present

   Working as a Senior Data Engineer building enterprise-scale AI-enabled healthcare data platforms across Azure and GCP cloud environments.Designed scalable real-time and batch pipelines using Spark Structured Streaming, Kafka, and Databricks to process healthcare datasets stored in ADLS Gen2. Built dimensional data models supporting BI reporting using Snowflake, BigQuery, and Synapse.Developed FHIR-compliant REST APIs using Python and FastAPI to standardize healthcare data exchange across Patient, Encounter, Observation, and Medication resources.Built LLM-powered applications implementing Retrieval-Augmented Generation (RAG) pipelines, semantic search, embeddings, and hybrid search architectures combining BM25 keyword search and vector similarity search.