Rishabh Gupta

About Rishabh Gupta

Principal Data Engineer(Lead) with 12+ years of Experience having extensive experience in…

Experience

1. Principal Software Engineer

   Oracle

   Mar 2021 — Present · Bengaluru, IN

   Designed and developed new ELT solution using Apache Airflow and EMR in AWS cloud • Used Apache Airflow for scheduling the DAGs and running various tasks like submitting EMR job, applying transformations at redshift and upserting the data into redshift. • Used Apache Spark(EMR) for fetching data from Source databases like Oracle and Aurora. • Was solely responsible for all the data migration from postgres to redshift and then from redshift to ADW(Autonomous Data Warehouse) in OCI. • Leading a team of 4 members with timely deliveries and smooth project movement. • Wrote DAGs and EMR code using python. • Experienced with LLM fine-tuning • Experienced with Grafana and Tableau

Education

• Gautam Buddha Technical University

  Bachelor’s Degree

  2008 — 2012

• O.S.V.N. Inter college U.P. Board

  12th

  2006 — 2008

• R.K.Mission

  10th; H.S

  2004 — 2006

Skills

• Open Scene Graphs
• Hdfs
• Hbase
• Shell Scripting
• Software Development
• Apache Pig
• Web Applications
• Sqoop
• C
• Microsoft Office
• Pl/Sql
• R
• Html
• Product Development
• Sql
• Windows
• Microsoft Foundation Classes
• Hive
• Etl
• Oozie
• Relational Databases
• Programming Languages
• Microsoft Sql Server
• Mysql
• Big Data Analytics
• Mapreduce
• Web Design
• Analytical Skills
• Oracle Sql Developer
• Informatica
• Unix Shell Scripting
• Hadoop Development
• Javascript
• Agile Methodologies
• Apache Spark