Uma Mahesh D

About Uma Mahesh D

Extensive IT experience of around 7 years with multinational clients which includes 4 years of Big Data-related architecture experience developing MapReduce, Hive, Pig, HBase, Spark, Sqoop, Flume, Oozie, Zookeeper, and Impala. Experience with large-scale development projects that are enterprise distributed systems.Expertise in Data summarization and analysis, Data Validation and verification, Data Cleansing, Data Completeness, and identifying data mismatch.Extensive working experience with MapReduce and various database technologies such as Cassandra and HBase.Experienced in Data Scrubbing/Cleansing, Data Quality, Data Mapping, Data Profiling, and Data Validation in ETLExtensive working knowledge of writing and implementing UDF’s in HIVE and PIG.Implementing the AWS Glue ETL framework to maintain high-scale data availability for large datasets.Developed workflows for batch load and an incremental load of data using Oozie and Spark.Worked on different file formats like XML, JSON, CSV, PAR, Avro, Parquet, ORC and used snappy compression to store them in HDFS.Worked on data pre-processing and cleaning the data to perform feature engineering and performed data imputation techniques for the missing values in the dataset using Python.Developed spark applications in python (PySpark) on the distributed environment to load a huge number of CSV files with different schema into Hive ORC tables.

Experience

1. Senior Python Engineer

   PNC

   Mar 2023 — Present · US

   United States