Sanket Suhagiya
Data Engineer | Python | Airflow | ETL | Data Governance | Google Cloud Certified
- Role
- Senior Data Engineer at LTIMindtree
- Location
- Mumbai, MH, IN
- LinkedIn followers
- 500 followers
About Sanket Suhagiya
Senior Data Engineer with 4+ years of experience in building scalable ETL pipelines and…
Experience
Senior Data Engineer
Jun 2022 — Present · Mumbai, IN
Cloud Migration & Orchestration (10 months)- Built Data Ingestion Pipelines for diverse sources (RDBMS, API, Files and EDW)- Proficiently leveraged Airflow and DataFusion for seamless Data Pipeline development on Google Cloud Platform- Reduced 50% cost by implementing re-use functionality on Dataproc compute clusters used by DataFusion.Marketing Data Analytics (4 months)- Developed data ingestion workflows for marketing analytics for sources like LinkedIn, Marketo, Matomo and Google Analytics- Built a pipeline template for API data ingestion with audit logging and failure notification, later used for creating 10+ pipelines.Intelligence Portal Migration (4 months)- Migrated critical data from Apache HBase to Google Bigtable leveraging Google DataFlow (Apache Beam)- Developed transformations to handle byte level incompatibility arising from Phoenix engine- Employed Python and Shell Scripting for efficient automation and rigorous testing.Data Governance & Compliance (1 year – ongoing)- Built an automated Privacy Fulfilment pipeline serving over 100 GDPR and CCPA requests every week with 98% uptime- Optimized the Privacy Fulfilment pipeline reducing cost and run duration by over 85% by changing the query model- Worked on Data mesh architecture for Governance handling 10+ domains and tables with GCP Dataplex and Catalog- Built GenAI powered Metadata Generator tool for BigQuery tables, used 150+ times every week for past 4 months- Built Data Catalog AI agent with RAG that helps users discover data assets in natural language from a corpus of assets- Implemented Policy as Code with Open Policy Agent (OPA) for Terraform IaC in Tekton CI/CD governing cloud resources- Built multiple dashboards in Looker Studio to gain insights on various deliveries and drive data driven solutions.
Education
Vidya Vikasini School ICSE
I.C.S.E.
2010 — 2016
St. Peter's College, Vasai
H.S.C.
2016 — 2018
University of Mumbai
Bachelor of Engineering - BE, Computer Engineering
2018 — 2022
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.