Mohansai Pulapa

About Mohansai Pulapa

Data Enthusiastic individual with 4+ years of experience as a Data Engineer in Big Data Development & Passionate about data with a good understanding of end-to-end data pipeline.Collaborated with clients & team to understand the requirement and designing the system which is time & cost efficient. Worked with Cloudera & AWS(S3, EMR, Glue, Athena & Redshift) Big data distributions and its different components. Ingested data from various RDBMS like SQL Server & Oracle into HDFS & vice-versa using Sqoop and worked with multiple file formats like Parquet, CSV. Created S3 buckets by dumping the required data files in raw format from HDFS using distcp commands. Extensively used Sqoop for dumping the data from disperate sources by creating sqoop jobs and client\'s share point or S3. Played vital role in Pre-processing(Validation & Cleansing) of structured and semi-structured data. Defined schema and created Hive tables i.e stage & core tables in HDFS using Hive queries with Partitioning and Bucketing to handle structured data and improve efficacy. Developed spark jobs using PySpark & Scala to perform data transformations by using Spark DataFrames & Spark Sql for improving performance and scheduled jobs using Oozie. Managed Hive Tables based on partitions & written Hive queries for further downstream processing. As per the business requirement storing the spark processed data in HDFS with appropriate file formats. Optimized spark code by implementing performance tuning techniques such as Broadcast joins, Dynamic partitioning, bucketing, cache & persist, coleasce over repartition, shared variables etc, Created views that helps visualization team to create amazing dashboards. Optimized the data pipeline by doing application level as well as resource level optimization to save overall cost by 35%. Reduced data shuffling across executors by using best practices of spark and optimizing the resources by properly configuring num-executors, executor-memory etc.Feel free to reach me at \"m••••••••@gmail.com\".

Experience

1. Senior Data Engineer

   Softborne Technology Solutions Pte. Ltd

   Nov 2025 — Present · Chennai, IN

Education

• Sathyabama Institute of Science & Technology, Chennai

  Bachelor of Technology - BTech, Electronics and Communication Engineering

• NRI Group of Institute

  INTERMEDIATE, MATHS PHYSICS CHEMISTRY

  2014 — 2016

• SURYA PUBLIC SCHOOL

  Class 10, General Studies