Milan Regmi

About Milan Regmi

I’m a Data Engineer with an M.S. in Artificial Intelligence from Yeshiva University (NYC), specializing in designing and deploying scalable data pipelines and cloud-native architectures across Azure, AWS, and Snowflake.At Charter Communications and Verisk Analytics, I built and optimized ETL workflows using PySpark, Airflow, and Azure Data Factory, improving data accuracy by 10%+ and cutting pipeline latency by over 40%. My work focuses on building reliable, high-performance systems that bridge data engineering and machine learning for smarter business insights.Skilled in PySpark, SQL, Snowflake, Databricks, and Power BI, with certifications in Microsoft Azure Data Fundamentals (DP-900) and AWS Cloud Practitioner, I aim to design data solutions that are efficient, secure, and insight-driven.Based in New York City | Open to Data Engineer, ML Engineer, or Cloud Data roles.

Experience

1. Data Engineer

   Charter Communications

   Aug 2024 — Present · New York, NY, US

   Designed and automated large-scale ETL pipelines using PySpark, Airflow, and Azure Data Factory to unify ERP (SAP), CRM (Salesforce), and third-party inventory data into Snowflake, cutting end-to-end latency by 42%. Built modular SQL and Python frameworks for data cleansing and aggregation across 5 TB+ datasets, and implemented a data-quality system with Alation and custom validation rules that raised accuracy from 88% to 98%.Developed Power BI dashboards for sales pipeline, retention, and churn analysis (–60% report time), and optimized Snowflake performance via partitioning, clustering, and materialized views (–37% query runtime). Led Teradata-to-Snowflake migration for 400+ tables, standardized lineage for 120+ datasets, and enforced PII/GDPR compliance with Collibra and Alation. Deployed CI/CD with GitHub Actions + Docker (–50% release cycles) and partnered with data-science teams to build SQL feature stores for predictive maintenance and customer-propensity models.Tech Stack: PySpark, Airflow, Azure Data Factory, Snowflake, Power BI, Alation, Collibra, Python, Git, Docker, SQL Server

Education

• St. Xavier's College, Maitighar

  High School Diploma, Science

• Pokhara University

  Bachelor's degree, Computer Engineering

• Yeshiva University

  Master's degree, Artificial Intelligence