Abhishek Sharma

About Abhishek Sharma

Overall 10+ years of industry experience in building robust data pipelines and driving software development initiatives. Possess 7+ years of experience in Hadoop ecosystem technologies, with a strong proficiency in Scala, Python, Java, SQL, Hadoop, Spark, Spark Streaming, Delta Lake, Apache Iceberg, HBase, Hive, Kafka, AWS, Amazon Deequ, Elasticsearch, Data Structures & Algorithms. Current Role:• Leading multiple data pipelines focused on performance management, overseeing end-to-end development, optimization, and maintenance. Responsible for driving technical excellence, mentoring team members, and ensuring the delivery of high-quality solutions.Key Achievements:• GATE 2016: Secured AIR-1254 demonstrating strong analytical and problem-solving skills.

Experience

1. Lead Data Engineer

   Jio Platforms Limited Jpl

   Apr 2023 — Present · IN

   Restructured and generalized Spark data pipeline framework to support multi-country network datasets with minimal code changes, enabling faster onboarding of new geographies and reducing development effort for future expansions.• Spearheaded architectural optimization for 4G reporting use-case by replacing full-scan Spark jobs with a pre-aggregated, partitioned reporting layer over HDFS-Parquet, reducing processing latency by 90% and improving user experience for real-time report access.• Worked on a PoC Project, including the integration of Amazon Deequ for automated data quality checks, enhancing data reliability and integrity in large-scale data pipelines.• Worked closely with the team to establish an in-house Hadoop cluster hosted on Azure VMs, optimizing it for scalable and efficient data processing. • Led the migration of the existing codebase to Spark 3.5, HBase 2.5, Scala 2.12, and Java 11, ensuring seamless compatibility and enhanced performance.• Led the development of Event-Based Data Pipelines for high-traffic events such as Mahakumbh-2025, Coldplay concerts, CWC, and IPL-2025, enabling real-time monitoring and analysis of 4G and 5G data traffic.

Education

• St. Arnold's School, Indore

  Class 10th CBSE, Physical Chemistry Mathematics

  2006 — 2007

• Jagannath University,Jaipur

  Bachelor of Technology (B.Tech.), Computer Science

  2010 — 2014

• St. Arnold's School, Indore

  Class 12th CBSE, Physical Chemistry Mathematics

  2008 — 2009

Skills

• Maven
• Spring Boot
• Microservices
• Bootstrap
• Java
• Dom
• Xml
• Ubuntu
• Web Services
• Html
• Jaxp
• Spring Framework
• Dtd
• J2ee Web Services
• Xslt
• Tortoise Svn
• C
• Programming
• SEO
• Javascript
• Sql
• Restful Webservices
• Linux
• Hibernate
• Xpath
• Core Java
• Xsl-Fo
• Json
• Data Structures
• Css