Aryadeep Ghosh
Data Engineer @ Accenture || Databricks, Microsoft Azure & Gen AI Certified || BSc CS
- Role
- Data Engineer at Accenture
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About Aryadeep Ghosh
Experienced data engineer with a proven track record of designing, developing, and maintaining scalable and robust data pipelines. I specialize in transforming complex data into actionable insights and building efficient ETL/ELT processes. I thrive on solving challenging problems and am always eager to learn and adapt to new technologies in the ever-evolving data landscape.
Experience
Data Engineer
Sep 2023 — Present · Bengaluru, IN
Architected and deployed 4 ELT pipelines on Databricks (utilizing Lakeflow Declarative Pipelines, Spark and Airflow) for high-volume data ingestion, resulting in 95% process automation, enhanced scalability and reduced latency.• Implemented 7+ data quality checks (e.g, schema validation, uniqueness, and null checks) directly within Databricks pipelines using custom PySpark scripts, leading to a 40% reduction in reporting errors over six months.• Integrated custom logging across all Databricks workloads using the Pyspark logging library, enabling proactive error detection and reducing average time-to-debug by 25%.• Automated the delivery of 3 executive reports by integrating Databricks SQL Alerts (leveraging custom HTML/CSS for presentation) with Power Automate workflows.• Developed and maintained 5 Power BI dashboards, incorporating advanced DAX queries, bookmarks, and toggles to deliver dynamic views, for consumption by 20+ stakeholders and cross-functional teams.
Education
St. Xavier's College (Autonomous), Kolkata
Bachelor of Science - BS
2020 — 2023
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.