Vidnyan Siddamshetty

Experience

1. Manager, Data Science Engineering

   Adobe

   Jul 2024 — Present · Lehi, UT, US

   I lead data engineering teams building enterprise grade data lake infrastructure that powers analytics and reporting. My focus is on architecting scalable platforms, developing frameworks that increase team productivity, and solving complex distributed systems challenges.I\'ve led the architecture and development of two generations of enterprise data lake platforms, first on AWS, then modernizing to cloud-native Azure infrastructure. My team and I built orchestration frameworks that became the organizational standard for pipeline development, handling SQL transformations, data migrations, and workflow management at scale.Beyond the data platform, I\'ve led and built both backend services that expose data through REST APIs and customer-facing dashboards, enabling self-service analytics reporting.My approach emphasizes building reusable frameworks over one-off solutions, implementing robust error handling and monitoring, and making architectural decisions that scale both technically and organizationally.Key areas of focus- Platform architecture and framework design- ETL/ELT pipeline development and orchestration- Multi-cloud data infrastructure (AWS, Azure)- API development and microservices- Performance optimization and reliability engineering- Connection pooling, circuit breakers, and distributed systems patterns

Education

• Nagpur University

  Bachelor’s Degree, Electrical, Electronics and Communications Engineering

  2009 — 2013

• University of Utah

  Master's degree, Information Systems

  2016