Ravi Shankar Gupta

About Ravi Shankar Gupta

Possesses over 17 years of specialized experience in Big Data Engineering and Data Analytics, encompassing the complete Software Development Life Cycle (SDLC), data validation processes, and production Go-Live activities.• Demonstrated expertise in utilizing Microsoft Azure resources—including Azure Data Engineering and Azure Data Factory (ADF)—to architect and implement scalable ETL and ELT workflows for complex data transformation and processing requirements.• Proven track record in developing real-time data analytics solutions with Microsoft technologies such as Azure Databricks and Delta Tables, enhancing data pipeline performance and operational efficiency.• Proficient in employing Big Data frameworks, including Apache Spark, PySpark, and Spark SQL, for distributed computing and advanced data processing initiatives.• Adept at creating insightful and interactive reports using Microsoft Power BI, contributing to robust data visualization and business intelligence outcomes.• Experienced in leading and mentoring teams to deliver data engineering projects that integrate Microsoft cloud services and advanced Big Data solutions.• Over 7 years of hands-on experience implementing Big Data technologies, including DataBricks, Python, Scala, Hadoop, and Kafka, to navigate complex data challenges.• Expert user of Hadoop ecosystem tools, such as HDFS and Spark, to develop scalable and efficient ETL/ELT workflows for both structured and unstructured datasets.• Skilled in collaborating within product development teams to deploy robust Big Data solutions designed for real-time analytics and data-driven decision-making.• Extensive experience with platforms such as Alteryx, Moogsoft AIOps, Tableau, and Kepware for comprehensive data processing, analysis, and reporting tasks.• Proficient in the application of Machine Learning algorithms, including both classification and regression techniques, to enhance predictive modelling and analytical accuracy.• Practical experience with Azure Databricks and IBM Watson technologies, leveraging AI capabilities to engineer advanced data solutions.• In-depth understanding of the Spark engine and distributed computing principles, supporting efficient large-scale data processing.• Knowledgeable in IoT analytics via PTC Thingworx tools, enabling actionable insights from connected devices and IoT data streams.• Demonstrated leadership in the execution

Experience

1. Senior Technical Architect

   HCLTech

   Mar 2026 — Present · Lucknow, IN

Education

• Himachal Pradesh University

  B.Tech, Information Technology

  2005 — 2009

• Birla Institute of Technology and Science, Pilani

  Master of Technology - MTech, Data Science and Engineering

Skills

• Soapui
• Big Data
• Mockito
• Json
• Core Java
• Spark
• Solr
• Apache Storm
• Spring
• Soap Webservices
• Mongodb
• Java
• Rabbitmq
• J2ee Application Development
• Soap
• Scala
• Restful Webservices
• Apache Zookeeper