Darshak Rai
Data Engineer @ Accenture | SQL · PySpark · Snowflake · Airflow · Kafka · dbt | Azure Databricks (Delta Lake, ADF) · AWS Glue/Redshift | Certified: Databricks, GCP
- Role
- Data Engineer at Accenture
- Location
- Mumbai, IN
- LinkedIn followers
- 500 followers
About Darshak Rai
Driving intelligent data systems that scale — from pipelines to platforms. As a…
Experience
Data Engineer
Jul 2023 — Present · Mumbai, IN
Partnered with cross-functional teams to translate insurance business requirements into ETL workflows using AbInitio and Snowflake, processing 10M+ records/day.• Automated Teradata → Snowflake replication via shell scripts and SIP jobs, reducing manual operations by 30%, and implemented row-count/checksum reconciliation.• Optimized SQL/PLSQL queries on multi-TB datasets by refactoring joins, applying window functions/CTEs, and predicate pushdown; improved runtime by up to 50%.• Designed and validated SCD Type-2 dimensions with surrogate/natural keys, effective/end dates, and late-arriving data logic to ensure historical accuracy and audit compliance.• Developed 20+ reusable Ab Initio graphs (Reformat, Normalize, Sort) with parameterization and restartability, standardizing batch transformations for downstream systems.• Drove Agile execution (stand-ups, reviews) and tracked deliverables via Jira, ensuring sprint progress and compliance.• Designed POCs on Azure Databricks + ADF, focusing on pipeline triggers, monitoring, and orchestration.• Developed PySpark batch scripts and evaluated Delta Lake (MERGE, schema evolution, time travel) on Databricks for capability building; ensured reliability via AutoSys job orchestration.
Education
St. Xavier's High School - India
SSC
University of Mumbai
Bachelor of Engineering - BE, Information Technology
Allen Career Institute
HSC
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.