Hardik Gupta
Cloud Data Engineer @ NucleusTeq • Ex - Capgemini • Scala • Python • Apache Kafka • Spark • AWS • Snowflake • DBT • Airflow • AWS Solutions Architect - Associate • AWS Certified Data Engineer - Associate
- Role
- Senior Engineer at NucleusTeq
- Location
- Indore, MP, IN
- LinkedIn followers
- 500 followers
About Hardik Gupta
Graduated in 2020 with a Bachelor of Engineering in Computer Science from Acropolis…
Experience
Senior Engineer
Aug 2022 — Present · Indore, IN
Experienced Data Engineer with a strong proficiency in a multitude of cutting-edge technologies including Databricks, AWS (S3, Glue, Athena, Lambda, EMR), Airflow, DBT, PySpark, Python, and Scala. Over five years, I\'ve honed my skills in architecting, developing, and optimizing data pipelines to ensure efficient extraction, transformation, and loading (ETL) of large-scale datasets with a wide range of file formats like PARQUET, JSON, CSV, TSV along with Apache Iceberg. My expertise extends to streamlining workflows, ensuring data quality, and facilitating data accessibility for actionable insights.At NucleusTeq, I spearheaded the design and implementation of scalable data pipelines on AWS. Leveraging Airflow, I automated ETL workflows, enhancing operational efficiency and minimizing errors. Additionally, I optimized PySpark jobs for improved performance in high-volume data environments. Collaborating closely with cross-functional teams, I provided technical support for analytics initiatives and ensured the reliability and scalability of our data systems through code reviews and troubleshooting.I\'m contributing in the development of data pipelines and assisted in optimizing data processing algorithms. I actively supported data quality efforts by implementing validation checks and monitoring mechanisms to uphold data integrity. Throughout my career, I\'ve demonstrated effective communication skills and a passion for leveraging innovative technologies to drive business growth and operational excellence in the realm of data engineering.
Education
Acropolis Institute of Technology and Research, Manglia Chouraha, Indore
Bachelor of Engineering - BE
2016 — 2020
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.