Shubham Aggarwal

About Shubham Aggarwal

8 Years of experience- Lead Data Engineer, Hands on BigData and Cloud based projects. Leading critical project delivery portfolio responsibility by providing optimal solution to business. Domain experience in Ecommerce, Telecom, Retail, Banking and Ad-Tech. Good exposure and experience in bringing products from concept to release in large scale data projects. Having solid exposure to execute large scale enterprise data solutions & an enthusiast on Cloud implementation with good knowledge on Azure. Dedicated, driven, hardworking individual with the intercommunication skills to work at all levels of the organization. Extensive experience in architecture and design of enterprise class and cloud-based software. Extensive experience in setting up new engineering teams, knowledge ramp-up and hiring. Managed cross functional team with direct/indirect reports. Drive the execution and delivery of features by collaborating with many cross-functional teams, and engineers. With years of industry experience, I have gained lot of valuable exposure in defining technology solutions. I am skilled at developing roadmap, frameworks, process and strategies while executing critical IT projects. Challenging status quo while focus on innovation and customer is my strength. Maintaining and fostering Org culture by interviewing and hiring best talent- Design and development of products from scratch (DataAnalysis, Estimations, Build, Test Strategy and Implementation)- Have experience of different flavors of cloud i.e. PaaS, IaaS and SaaS for public, private and hybrid cloud- Smooth Migration of On-Prem Solutions to Cloud based solution- Promote and Practice DevOps to boost Speed To Market KPI - Connect with source, Setting up Data Lake and designing and building ETL process- Enterprise Architecture, OOPS, Design Patterns, and Agile scrum- Program management experience- Data Science projects optimization experience, optimized 90%- Optimization of Data Engineering projects - Technology migration from Oracle to Big Data Bigdata, Hive, Hbase, Spark, Python, Hadoop, Sqoop, Nifi Cloud: Azure (BLOB, ADLS Gen2, Databricks, AZCopy, Azure Data Factory-ADF, Dela Lake), AWS (S3,Lambda, Glue, Athena, Redshift) ETL: Talend Database: MySql Hive, PostgreSql, Snowflake (DWaaS) Scheduler: Airflow, Oozie, ControlM Scripting: Shell, Python Languages: Python, Java (R & Scala Beginner) Dashboarding/Visualisation: Incorta, Splunk. Tableau, PowerBi Log Monitoring Dashboards: Datadog Other Applications: ML, CICD, Jenkins, Git, Linux, Pig, Kafka

Experience

1. Implementation Engineer Partner Data Engineer

   Cloudyboss

   Jun 2017 — Present

Education

• JMIT,Radaur

  Bachelor of Technology (B.Tech.), Information Technology

  2011 — 2015