Chethan H O
Azure Data Engineer | Databricks | ADF | Power BI | AWS Athena| Multi-Cloud | Delta Lake | Snowflake|Solving Data Engineering & Analytics Challenges
- Role
- Azure Data Engineer at Tata Consultancy Services
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About Chethan H O
Senior Data Engineer at IBM with 12+ years of experience building scalable, cloud-native…
Experience
Azure Data Engineer
Feb 2025 — Present · Bengaluru, IN
Worked on Azure-based data engineering project leveraging Databricks, Azure Data Factory (ADF), and Microsoft Fabric to deliver large-scale data pipelines and analytics solutions.Built metadata-driven pipelines in ADF for ingesting 50+ SQL Server and flat-file sources into ADLS Gen2.Implemented Delta Lake (Bronze → Silver → Gold) layers in Databricks with schema enforcement and evolution.Designed incremental ingestion framework using watermarking and CDC logic, reducing processing time by 65%.Developed PySpark transformations for cleansing, deduplication, and dimensional modeling.Integrated with Microsoft Fabric for self-service reporting, enabling business teams to access curated datasets.Delivered Power BI dashboards with DAX measures for sales and operations analysis.Implemented data quality checks (null, duplicates, referential integrity) at ingestion and transformation layers.Optimized jobs using partitioning, broadcast joins, and Delta optimization (Z-ORDER, file compaction).
Education
University of Mysore
Master's degree
2011 — 2013
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.