Unifers.ai

Shubhadip Dasgupta

Technical Manager at Accenture | PySpark | SQL |4x Databricks Certified | AWS Certified Data Analytics Speciality

Role
Technical Architect at Accenture
Location
Kolkata, WB, IN
LinkedIn followers
500 followers
Information TechnologyView LinkedIn profile

About Shubhadip Dasgupta

Experience in Health Care, Telecommunication and Financial Domain.2. Extensive Experience in Datawarehouse Design and Modelling, ETL flow design and Implementation of complex data integration projects from Scratch.3. Experience in DataLake design in s3 using best principles. Extensive experience in implementing complex data transformation logic using PYSPARK and Spark SQL. Comfortable with Standard Spark Architecture, Execution Models, Deployment Modes, Configuration variables and Performance Tuning.5. Have extensive experience in implementing complex ETL transformations in AWS Glue. Extensively used Glue Notebooksfor implementing complex data transformations using Pyspark and Spark SQL.6. Experience using python in AWS lambda for file trigger and calling Glue jobs and redshift stored procedures.7. Implemented data quality framework using AWS Glue Data Quality which enabled separating out corrupt data before ETL process.8. Have Extensive Experience in Datawarehouse Design and Modelling in AWS Redshift. Implemented ELT framework where complex data transformation was performed using Stored procedures in Redshift. Also proficient in redshift best practices for table design and data loads.9. Used Athena for querying DataLake tables stored in Glue Data Catalogue and Redshift spectrum for integrating data from both DataLake and Datawarehouse.10. Implemented a robust Audit and Logging and error handling framework using Glue and Redshift Stored procedure. Used python exception handling for Glue and stored Proc Exception handling for Redshift stored procedures.11. Performed orchestration using Step Functions and Glue workflows12. Implemented various alarms and events using EventBridge and CloudWatch

Experience

  1. Technical Architect

    Accenture

    Aug 2024 — Present · Kolkata, IN

Education

  • ARMY PUBLIC SCHOOL

    SCIENCE

  • DAV PUBLIC SCHOOL

    CBSE, SCIENCE

  • Vellore Institute of Technology

    B-TECH, TELECOMMUNICATION

    2004 — 2008

Skills

  • Unix
  • Data Modeling
  • Shell Scripting
  • Unix Shell Scripting
  • Extract, Transform, Load (Etl)
  • Data Warehousing
  • Data Integration
  • Abinitio
  • Ab Initio
  • Pl/Sql
  • Teradata
  • Business Analysis
  • Requirements Analysis
  • Netezza
  • Sdlc
  • Databases
  • Sql
  • Software Development Life Cycle (Sdlc)
  • Performance Tuning
  • Business Intelligence

Find verified contacts for anyone on LinkedIn

Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.

Start for freeSee how it works

Free plan included · No credit card required

This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.

Shubhadip Dasgupta — Technical Architect at Accenture in Kolkata, WB, IN | Unifers