Sandip Bhosale
Data Engineer @Tata Consultancy Services
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Tata Consultancy Services
Designed and improved large scale Pyspark based ETL pipelines to process terabytes of data for analytics and reporting. Enhanced Hive queries for data transformation and performance tuning, reducing query execution time by 40%. Debugged Spark jobs to improve performance. Optimized PySpark jobs to improve execution time by 30%, handling 1M+ records. Implemented ADLS Gen2 for large-scale data storage and processing. Built and deployed 15+ data pipelines using Azure Data Factory. Created linked services, Datasets and parameterized dataset for copying data.Collaborated with data engineers to troubleshoot and resolve complex PySpark job failures stemming from data skewness, contributing to the successful processing of over 1M data points.
EDUCATION
Savitribai Phule Pune University
Bachelor's degree
Maharashtra State Board of Technical Education (MSBTE)
Diploma
ABOUT SANDIP BHOSALE
Azure Data Engineer with 3.7 years of experience at TCS, in data engineering field, worked on Azure Databricks, PySpark, and data pipeline development. Seeking to leverage my skills in data engineering and analytics to drive business insights and innovation. Expertise in SQL,Python, big data technologies Hadoop, Apache Spark, Hive.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.