Rakesh M.

About Rakesh M.

I’m a hands-on Data Engineer with deep expertise in building scalable data pipelines…

Experience

1. Senior Data Engineer

   Wells Fargo

   Mar 2018 — Present · Charlotte, NC, US

   Led the LIBOR to SOFR transition by building PySpark pipelines that ensured accurate benchmark rate conversion for millions of loans and assets.• Designed scalable ETL frameworks using PySpark, Spark SQL, and Hadoop to process multi-terabyte datasets with optimized performance and schema evolution support.• Built Python-based automation scripts for data validation, anomaly detection, and reconciliation, improving data accuracy by 99.9%.• Migrated enterprise datasets to a centralized data lake, enabling faster access and integration for downstream BI and analytics teams.• Collaborated with data scientists, product owners, and QA teams to define requirements and deliver clean, ready-to-consume data models.• Applied advanced Spark optimization techniques (broadcast joins, caching, partitioning) to reduce job runtimes by 40%.• Developed Power BI dashboards to track data pipeline health and showcase SOFR conversion metrics to compliance teams.• Integrated structured and semi-structured files (JSON, Parquet, Avro, CSV) into unified datasets using metadata-driven pipelines.• Implemented robust monitoring and alerting for Spark jobs using Python-based logging and error-handling modules.• Explored emerging tools like PyArrow, FastAPI, and Dask for modernizing future-state architecture and API enablement.

Education

• Jawaharlal Nehru Technological University, Hyderabad

  Bachelor's degree

  2009 — 2013

• Sacred Heart University

  Master's degree

  2014 — 2016