Devanshi Desai

Experience

1. Data Engineer

   REPAY - Realtime Electronic Payments

   Oct 2022 — Present · Buckhead, GA, US

   As a part of data team, I help built data warehouse from scratch in AWS, where I am transforming the data from the bronze layer to the silver layer and lastly resting in the S3 bucket, the gold lake layer. Mapping ETL diagrams in Lucid Charts to plan data migration from legacy systems to AWS, Metabase, Databricks. Created strict data validation rules for the ingested, transformed and output data using Python\'s Pydeeque and Great Expectations libraries. Monitored data and ML pipeline’s DAG runs for successful data orchestration in Airflow and Databricks. Frequently deploying Kafka on Kubernetes to automate deployment, scaling and operation of containers across clusters of hosts. Help built REPAY Insight Center (RIC) an internal financial file management system used by their finance teams for their monthly, uploads and downloads. Utilized Datahub as a central space for Data Storage, Definition, Delivery, and Governance. Extracted business insights from sales data on Showpad through deep investigation and data modeling Designed process for paid media data attribution for Marketing Analytics in Hubspot Documenting the technical process in Confluence Page Documentation and tracking the project progress using Jira.

Education

• Stevens Institute of Technology

  Master's degree, Information Systems Conc. Data Analytics and Machine Learning

• R. N. G. Patel Institute of Technology-RNGPIT (An Autonomous Institute U/s UGC Act 1956)

  Bachelor's degree, Computer Science