Sushma Manjunath

About Sushma Manjunath

Data Engineer with 3+ years of experience including large data sets of Structured and Unstructured data, Data Acquisition, Data Validation, Predictive modeling, Statistical modeling, Data modeling, and Data Visualization. Hands-on experience in implementing LDA, and Naive Bayes and skilled in Random Forests, Decision Trees, Linear and Logistic Regression, SVM, Clustering, neural networks, and Principle Component Analysis. Excellent knowledge of Big Data ecosystems using Hadoop, Pig, Hive, HDFS, MapReduce, Sqoop, Storm, Spark, Airflow, Snowflake, Kafka, Oozie, and Zookeeper. Experienced in using Pig scripts to do transformations, event joins, filters and pre-aggregations before storing the data in HDFS. Proficiency in an array of Python packages such as NumPy, Pandas, Matplotlib, SciPy, Scikit-learn and Seaborn, TensorFlow, enabling the development of intricate machine learning models and sophisticated data manipulations.

Experience

1. Data Engineer

   Principal Financial Group

   Apr 2023 — Present · NJ, US

   Implementing and maintaining a machine learning pipeline for real-time data processing, enabling faster decision-making and reducing response time by 35%. Developing scripts to load data to hive from HDFS and involved in ingesting data into the Data Warehouse using various data loading techniques. Executing Data pipelines for big data processing using Spark transformations and Python API and clusters in AWS Handled importing data from various data sources, performed transformations using Hive, and MapReduce, and loaded data into HDFS. Improving Spark Streaming programs to process near real-time data from Kafka, and process data with both stateless and state-full transformations.

Education

• Sri Venkateswara College of Engineering

  Bachelor of Engineering - BE

  2016 — 2020

• Stevens Institute of Technology

  Master of Science - MS

  2022 — 2023