Chetan Parishwad

About Chetan Parishwad

Results-driven Senior Data Engineer with 11 years of experience designing and delivering large-scale, batch and real-time data solutions in semiconductor, finance, healthcare, and manufacturing domains. Proven expertise in building scalable data pipelines, predictive analytics platforms, and automated systems using Spark, Kafka, Flink, SQL, Python, and Snowflake on cloud platforms including Azure, AWS, and Databricks. Adept at optimizing data architecture, reducing processing times, enabling real-time insights, and boosting operational efficiency. Strong track record of leading end-to-end projects, collaborating with cross-functional teams, and translating business needs into robust data products that have delivered multi-million-dollar business value.I’ve had the incredible opportunity to found two startups — one a digital Menu and ordering app, another a web platform. While they didn’t succeed in the way I hoped, they taught me invaluable lessons in product development, customer empathy, agility, and resilience. These experiences have shaped the way I approach problems, build systems, and collaborate cross-functionally in my current roles.

Experience

1. Lead Data Engineer

   Applied Materials

   Apr 2023 — Present · Santa Clara County, CA, US

   ZeroNC - AI/ML Quality Non-Conformance Automation Tech Stack – NLP, NLTK, Spark, SQL, Python, MLflow, Databricks• Architected AI/ML framework using NLP to automate quality non-conformance event classification• Built scalable solution processing service cases annually• Implemented root cause mapping algorithms, tracing NC events to source tasks• Reduced analysis time from 10+ minutes to seconds; delivered $9M+ annual savings• Won the President\'s Quality Award 2025 from the RMS - Automated Resource Scheduling & Optimization Tech Stack – SAP, SQL Server, RESTful APIs, Spark, SQL, Python, AWS Databricks• Designed automated Resource Management System for semiconductor equipment installations• Built pipelines processing 10M+ records daily from multiple enterprise sources• Saved $1M annually and enabled real-time resource visibility iDCL - Customer-Driven Installation Planning Tech Stack – Databricks, Spark, PySpark, SAP ERP/CRM, React, Elasticsearch, Airflow, Docker, Kubernetes• Acted as technical advisor conducting on-site interviews to understand customer pain points• Built intelligent planning engine ingesting SAP ERP/CRM data to auto-generate installation schedules• Delivered solution integrating backend pipelines with React frontend and Elasticsearch APIs• Reduced planning time by Enterprise Cloud Migration - Cloudera to Databricks on Azure Tech Stack – Databricks (Azure), Cloudera, Hive, Spark, Python• Directed 3-person team migrating 1,200+ Hive and Spark scripts from Cloudera to Databricks on Azure• Conducted 20-30 POCs evaluating Snowflake vs Databricks that influenced platform selection• Refactored 23% of scripts, converted shell scripts to Python, established <1% data accuracy validation• Reduced long-term costs through cloud auto-scaling

Education

• Bangalore High School

  SSLC

• RV College Of Engineering

  Master of Computer Applications - MCA

  2011 — 2014

• Vijaya College, Bangalore

  12th Standard (Pre-University College), Physics, Maths and Computer Science

• Karnatak University

  Bachelor of Computer Applications - BCA

  2008 — 2011

Skills

• Jsp
• Html
• Spark
• Big Data
• Sql
• Linux
• Asp.net
• Mysql
• C
• Programming
• Xml
• Microsoft Excel
• Microsoft Office
• Hive
• Javascript
• Apache Kafka
• C++
• Software Development
• Teamwork
• Java
• Windows
• Eclipse
• Jquery
• Hadoop
• Php
• Apache Pig
• Css
• C#