Rohit Vatsa
Azure Data Engineer | Databricks & Delta Lake | ADF • PySpark • Lakehouse Architectures • Python
- Role
- Data Engineer Skyworks Solutions (Via Transformhub) at TransformHub
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Rohit Vatsa
I’m a Data Engineer with 4 years of experience building and operating production-grade data platforms on Azure. I design scalable ETL pipelines, optimize Spark workloads, and deliver reliable, production-ready data for analytics and BI.At Skyworks Solutions (engaged via Transformhub) I design and maintain end-to-end data pipelines using Azure Data Factory, Databricks (PySpark / Delta Lake / DLT) and ADLS Gen2. I operate pipelines that process 2+ TB/day with 99.9% SLA compliance, and I’ve reduced job runtimes by ~45% and compute costs by ~20% through partitioning, caching, and query refactoring.I implemented a Delta Lakehouse pattern with schema evolution, incremental loads, and automated data-quality checks, which reduced production incidents by ~50% and improved downstream reliability. I also own pipeline monitoring, alerting, and runbooks to keep high-volume jobs stable and observable.Daily stack: Azure Data Factory, Azure Databricks, ADLS Gen2, PySpark, SQL, Git, and CI/CD for data pipelines.Certifications: Microsoft Certified: Azure Fundamentals (AZ-900), Databricks Lakehouse Fundamentals.If you’re scaling an Azure data platform and need someone who can own pipelines end-to-end and drive operational maturity, let’s talk.
Experience
Data Engineer Skyworks Solutions (Via Transformhub)
Oct 2025 — Present · Mumbai, IN
Built Databricks notebooks and Delta Lake pipelines (including DLT) to implement incremental loads, schema evolution, and automated data quality checks. Optimized PySpark jobs using partitioning, caching, and query refactoring — reduced runtime ~45% and lowered compute costs ~20%. Implemented robust monitoring, alerting, and runbooks (ADF + Databricks + Log/metrics) to cut production incidents by ~50% and speedup operational MTTR. Led migration of legacy ETL patterns into Delta Lakehouse architecture; created ADF patterns and parameterized templates for repeatable ingestion.Tech stack: Azure Data Factory, Azure Databricks (PySpark, Delta Lake, DLT), ADLS Gen2, Azure SQL/SQL Server, Git, CI/CD pipelines.
Education
Savitribai Phule Pune University
Bachelor of Engineering - BE
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.