Karan Gaur
Pyspark || Python || AWS || SQL || Databricks developer
- Role
- Consultant at Deloitte
- Location
- Gurugram, IN
- LinkedIn followers
- 500 followers
About Karan Gaur
Worked on various data migration projects. Technology used : Spark Framework…
Experience
Consultant
Apr 2022 — Present · Gurugram, IN
Developed and maintained a robust and configuration based data ingestion framework leveraging Databricks, AWS Glue, Amazon S3,Delta lake, autoloader and Amazon Redshift to streamline the process of collecting and storing data from various sources- Designed and Developed end-to-end ETL (Extract, Transform, Load) pipelines, incorporating Data bricks workflow to efficiently extract data from diverse sources, transform it according to business requirements, and load it into Redshift for analytics- Integrated Delta Lake as a storage layer, providing ACID transactions, schema evolution, and improved data reliability for data ingested from multiple sources- Implemented Delta Auto Loader to automate the ingestion of new data into Delta Lake, ensuring real-time data availability and reducing manual intervention- Collaborated with cross-functional teams, including data engineers, data scientists, and business analysts, to understand data requirements and deliver solutions that met their needs.
Education
DIT UNIVERSITY
Bachelor of Technology - BTech
2015 — 2019
Dr. Virendra Swaroop Public School Cantt.
Twelth Grade
2013 — 2014
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.