Arun Rathi
Senior Data Engineer | Databricks & Spark | Azure Data Platform | ETL & Lakehouse Architecture | PySpark | ADF | ADLS Gen2 | Performance Optimization | Cloud Data Engineering | Microsoft Fabric | Deloitte | NIT
- Role
- Data Engineer (Databricks Azure Data Platform) at Deloitte
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Arun Rathi
I am a Data Engineer with 5+ years of experience designing and optimizing scalable data platforms on Azure and Databricks. My work focuses on building high-performance ETL pipelines, modernizing legacy data architectures, and enabling enterprise-scale analytics through lakehouse design patterns.I have led migration initiatives from traditional ETL frameworks (Talend) to Databricks-based architectures, improving scalability, performance, and maintainability. I specialize in Spark performance optimization, metadata-driven pipeline design, and building reusable engineering frameworks for large-scale data ecosystems.Key Areas: • Databricks, PySpark, Spark Optimization • Azure Data Factory, ADLS Gen2, Azure Functions • ETL Modernization & Data Platform Migration • Lakehouse Architecture & Data Engineering Design • SQL & Data Modeling • Cloud Data Platform EngineeringI am passionate about building robust data engineering solutions and continuously evolving toward senior-level architecture and design roles. Lets Connect and discuss further.
Experience
Data Engineer (Databricks Azure Data Platform)
Feb 2024 — Present · Gurugram, IN
Led Talend -> Databricks migration initiativeDesigned reusable frameworksArchitecture ownership elements
Education
National Institute of Technology, Kurukshetra, Haryana
Master's degree
2018 — 2020
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.