Pravin Ag
Data Engineer at Cognizant
- Role
- Associate at Cognizant
- Location
- Erode, TN, IN
- LinkedIn followers
- 500 followers
About Pravin Ag
Experienced Data Engineer with 3+ years of hands-on experience in migration projects involvingtransitioning Airflow pipelines to Databricks workflows, converting Trino queries to optimized Spark queries, and handling streaming ingestion for healthcare applications. Strong expertise in Azure cloud services, Databricks platform, and data pipeline development with proven track record in data validation, testing strategies, and cross-functional collaboration.
Experience
Associate
Jun 2022 — Present
Leading Enterprise Migration Projects: Spearheading large-scale Hadoop-to-Databricks modernization, architecting IICS taskflows and mappings for seamless migration from legacy Hive systems to modern lakehouse architecture- Performance Excellence: Engineered high-performance PySpark jobs with Delta Lake optimization (Z-ordering, data skipping, partition pruning), delivering:60% reduction in query execution time40% improvement in storage efficiency- Advanced Data Architecture: Designed multi-zone data architecture (raw, refinement, curated zones) using Delta Lake technology, ensuring optimal data governance and analytics capabilities across healthcare platforms- Integration & Modernization: Developed robust IICS taskflows with automated error handling and data lineage tracking. Transitioned Airflow pipelines to Databricks workflows and converted Trino queries to optimized Spark. Implemented real-time streaming solutions (Fitbit data processing) integrated with Event Hub and Cosmos DB- Data Pipeline Development: Architected comprehensive ETL workflows from Azure Data Lake Storage into Databricks, implementing transformation logic across Databricks tables, Cosmos DB, and SQL Server- Quality & Leadership: Implemented automated data validation frameworks using Python utilities, while leading cross-functional teams of data engineers, architects, and project managers across multiple healthcare projects.
Education
Shri Mahaa School
Higher Secondary
2015 — 2017
Kongu Engineering College
M.Sc
2017 — 2022
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.