Mainak Dasgupta
Data Engineer II @ Amazon | Ex-Walmart, Deloitte, TCS Digital | Spark | SQL | Python | AWS l GCP
- Role
- Data Engineer Ii at Amazon
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About Mainak Dasgupta
Data Engineer II at Amazon with a total 7 years of experience. Having extensive hands on experience in designing, building and deploying scalable Big Data solutions for batch (in TB upto PB level in data size) and streaming data (Throughput of upto 1M / s).Experienced in retail, Life Sciences, Healthcare, Banking and Telecom industries and their big data use cases- Building scalable ETL solutions using Apache Spark with Scala and Python on Dataproc and EMR and creating DWH on BigQuery - Built Glue pipelines with S3 data extraction and Redshift as data warehouse solutions - Led data migration from Dataproc 1.5 to 2.1 and Spark 2.4 to Spark 3.3- Built complex payload extraction and built NRT pipeline - Built Quality data and creating Tableau Dashboards for effective data visualisation - Exposure to SparkML and BQML for modeling the gold DWH dataTechnical skills: Python, Spark, SQL, ETL, ELT, Kafka Streaming, AWS DE - S3, Glue, Athena, Lambda, Kinesis, Redshift, GCP DE - Dataproc, BigQuery, GCS, Composer
Experience
Data Engineer Ii
Aug 2024 — Present · Bengaluru, IN
Education
RKVM Barrackpore
Higher Secondary, Science
2012 — 2014
Institute Of Engineering and Management
Bachelor of Technology, Electrical, Electronics and Communications Engineering
2014 — 2018
RKVM barrackpore
Secondary, General
2000 — 2012
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.