Shahar Katz

About Shahar Katz

Senior Big Data Engineer & Architect with 10+ years of experience building scalable data platforms and ML infrastructure. Proven track record in MLOps, Databricks, Spark, and cloud-native architectures (AWS & GCP). Experienced in designing 99.99% available data pipelines, migrating to open-source ML platforms (MLflow, JupyterHub, Ray), and leading cross-functional teams to deliver data solutions that power business and product decisions.

Experience

1. Senior Data Engineer

   Zoom

   Jun 2022 — Present · West Hartford, CT, US

   Led Databricks platform administration across 10+ workspaces, dozens of clusters, and dozens of monthly jobs—cutting onboarding time by 50% and compute costs via 20% faster PySpark queries.Architected and maintained highly available (99.99%) ingestion pipelines and data warehouse (Snowflake, Airflow, Spark, Hive, Trino).Drove Zoom’s machine learning platform migration to open-source (JupyterHub, MLflow, Ray), enabling flexible, cost-efficient, and scalable model training and inference.Designed and deployed secure model serving pipelines, integrated with online (DynamoDB) and offline feature stores to accelerate ML adoption.Spearheaded data governance initiatives for compliance with global privacy regulations (Datahub, OneTrust).As Senior Engineer, lead sprint planning, standups, and grooming sessions to align cross-functional teams and ensure timely delivery of infrastructure projects.

Education

• The College of Management Academic Studies

  Bachelor’s Degree, Computer Science

  2012 — 2015

Skills

• C#
• Oop
• Java
• Javascript
• Html 5
• Visual Studio
• C
• Programming
• Software Development
• Python
• Regular Expressions
• C++
• Css
• Mysql
• Microsoft Sql Server
• Xpath
• Html5
• Linux
• Eclipse
• Asp.net Mvc
• Selenium
• Css3