Sandeep Chaurasiya
B.Tech in Computer Science Engineering
- Role
- Data Engineer at LTIMindtree
- Location
- Mumbai, MH, IN
- LinkedIn followers
- 500 followers
About Sandeep Chaurasiya
Having 4.2years of experience in Azure Data factory,Azure databricks,Azure…
Experience
Data Engineer
Aug 2020 — Present · Pune, IN
Created Linked Services for multiple source system (i.e. SQL Server, ADLS gen2, BLOB, File Storage and Table Storage). Created Pipeline to extract data from on premises source systems to azure cloud data lake storage; Extensively worked on copy activities and implemented the copy behavior such as flatten hierarchy, preserve hierarchy and Merge hierarchy; Implemented Error Handling concept through copy activity. Exposure on Azure Data Factory activities such as Lookups, if condition, for each, Set Variable, Append Variable, Get Metadata, Filter and wait. Configured the logic apps to handle email notification to the end users and key shareholders with the help of web services activity; create dynamic pipeline to handle multiple source extracting to multiple targets extensively used azure key vaults to configure the connections in linked services. Configured and implemented the Azure Data Factory Triggers and scheduled the Pipelines; monitored the scheduled Azure Data Factory pipelines and configured the alerts to get notification of failure pipelines. Extensively worked on Azure Data Bricks with the help of Spark-SQL to implement SCD-1, SCD- 2 approaches. Developing Spark (PySpark) notebooks to transform and partition the data and organize files in ADLS.Created Linked Services for multiple source system (i.e. SQL Server, ADLS gen2, BLOB, File Storage and Table Storage). Created Pipeline to extract data from on premises source systems to azure cloud data lake storage; Extensively worked on copy activities and implemented the copy behavior such as flatten hierarchy, preserve hierarchy and Merge hierarchy; Implemented Error Handling concept through copy activity. Exposure on Azure Data Factory activities such as Lookups, if condition, for each, Set Variable, Append Variable, Get Metadata, Filter and wait. Configured the logic apps to handle email notification to the end users and key shareholders with the help of web services activity; create dynamic pipeline.
Education
Rajiv Gandhi Proudyogiki Vishwavidyalaya (RGPV), Bhopal
BTech Computer Science Engineering
2018 — 2022
Truba College of Science & Technology
Bachelor of Technology - B.Tech
2018 — 2022
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.