Janki Patel

About Janki Patel

U.S. Citizen and high-impact Data Engineer with 3+ years architecting and scaling mission-critical data platforms across pharma,healthcare, and retail. Expert in ETL/ELT pipelines, Kafka streaming systems, and cloud data warehouses on AWS and Azuredelivering 35–60% production performance gains. Strong expertise in PySpark, Snowflake, Databricks, Airflow, dbt, data governance, and scalable data engineering solutions.

Experience

1. Data Engineer

   Stanford Health Care

   Jul 2024 — Present

   Engineered PySpark ETL pipelines on Databricks and Snowflake processing 10TB+ clinical records daily, reducing batch processing runtime by 42%.• Migrated 15+ on-prem healthcare workflows to AWS-based Databricks Lakehouse architecture, lowering infrastructure costs by 35%.• Built dbt transformation models with automated testing and lineage tracking across bronze/silver/gold data layers, improving enterprise data reliability.• Automated ingestion workflows using Apache Airflow, Python, and AWS Glue, eliminating 15+ hours of weekly manual operations.• Architected Kafka and Spark Structured Streaming pipelines enabling sub-second real-time clinical event processing.• Optimized Snowflake query performance using clustering and partitioning strategies, improving dashboard response times by 40%.

Education

• Pennsylvania Sate University

  Bachelor of Science - BS, Computer Science

• San José State University

  Master of Science, Computer Science