Subham Chakraborty

Senior Manager @Tata Motors

Pune, IN

Orchestrated a seamless migration of 500 GB of critical data from on-premises to Azure, enhancing system efficiency by 10%.• Ingested data from 10+ different sources using Azure Data Factory and stored it in Azure Data Lake Storage Gen2 through automated pipelines.• Processed and transformed 200 GB of data daily using Azure Data-bricks and PySpark.• Collaborated with 20+ business analyst and internal stakeholders to translate their needs into technical requirements and data models.• Optimized SQL Queries, reducing execution time by 5% which significantly decreased server load and improved application performance for end users.• Resolved Spark join skew issues in large datasets using salting and adaptive query execution, improving job speed by 80%.• Developed and implemented advanced data visualization dashboards using Power BI, leading to an increased data driven decision-making processes by 15%.• Guided the on-boarding process for 2 new team members, enhanced understanding of project requirements, and reduced initial training time by 15%, ensuring quicker ramp-up to full productivity.