Rahul Gaulkar

About Rahul Gaulkar

Highly passionate and results-driven Big Data Developer with over 10 years of experience in the banking and financial services sectors. I specialize in designing and implementing robust, large-scale data processing and real-time analytics solutions that solve complex business challenges. My expertise includes Spark, Scala, Scoop, Hive, EMR, S3, Athena, and Redshift.Beyond my technical skills, I am an experienced leader in effective team management, recruiting new talent, and fostering growth through cross-functional training.

Experience

1. Senior Big Data Developer

   Tata Consultancy Services

   Sep 2021 — Present · Pune, IN

   Designing and optimizing big data pipelines using Apache Spark, Scala, and SQL to process upto 300TB of structured and unstructured data with different optimization techniques•Reducing intraday job run time from 45 minutes to 20 minutes by rewriting the code, helped end user to access the data within 20 minutes from staging side without any delay. Resulted into enhancing the production efficiency•Developing data ingestion mechanism to ingest about 10 million records from staging layer to standardization layer. Contributed to enhancing the speed and effectiveness of data processing by optimizing jobs•Automating housekeeping jobs for the cleanup process, cleaned unused files, improved efficiency of the cluster. Executed hive scripts to perform adhoc analysis on 10 Petabyte datasets stored in a Hadoop Distributed File System, HDFS•Created more than 12 complex software applications utilizing SQL, Scala, Hadoop, and Sqoop tools for Citi Bank and adhered to software development release processes

Education

• Nagpur University

  Bachelor of Engineering - BE, Electrical, Electronics and Communications Engineering

• GH Raisoni College of Engineering

  Communication Engineering

Skills

• C
• Toad for Oracle
• Linux
• Regression Testing
• Manual Testing
• Automation Testing
• Rtc
• Rqm
• C
• Rft
• Basic Java
• Java