Jeevan Gopalappa Raghupathy

Data Engineer @Integral Ad Science

Irving, TX, US

Developed a production-grade Azure Lakehouse on ADLS Gen2 using Delta Lake and Medallion architecture, enabling scalable analytics on 50TB+ of logistics data for 100+ users and improving enterprise data reliability.•Built Kafka-compatible real-time streaming pipelines using Azure Event Hubs and Spark Structured Streaming, processing 15M+ events/day and cutting shipment status latency from 8 hours to under 30 seconds.•Developed and orchestrated batch and real-time ETL/ELT pipelines in Azure Data Factory, integrating 8+ enterprise systems (ERP, WMS, TMS) while maintaining 99.5% SLA adherence across production workloads.•Designed analytics-ready data warehouses and star-schema data marts in Azure Synapse Analytics, accelerating BI and operational reporting and improving query performance by 60%.•Optimized Spark workloads and implemented DevSecOps practices using AQE, broadcast joins, GitHub, Jenkins, and Azure Key Vault, reducing cloud costs by 25%, strengthening security via RBAC, and shortening release cycles to under 30 minutes.

East Texas A&M University

Master's degree, Business Analytics

Visvesvaraya Technological University

Bachelor of Engineering - BE, Computer Science