Shubham Amilkanthwar

About Shubham Amilkanthwar

As a Data Engineer, my goal is to deliver the best data foundation that drives impact through data-informed decision-making as well as to provide the most conformed, consistent, scalable, timely, accurate, complete, and fully integrated analytics platform that will drive growth, user value, and revenue. My vision is to use analytics to enable the product organization to make data-informed decisions.Experience in building a Financial Data Pipeline that accurately gives Non-GAAP recurring revenue and can categorize the Events in Conversion, Expansion, and Churn as well as determine Product lead VS Sales lead opportunities. My skills include but are not limited to:Specialties: Terraform, Streamlit, Snowpark, Databricks, ETL, Tableau, Data Automation, Data Engineering, OpenAI, Anthropic, Langchain, Postgres, Salesforce, NetSuite, Zuora, Recurly, Snaplogic, Airflow.Machine Learning - Numpy, Pandas, Scikit, TensorFlow, KerasProgramming Languages: Python, R, SQLTools: Amazon AWS S3, EC2, RDS, EKS, ECR, Docker, Glue, Git, Azure, Terraform, Iceberg, Delta

Experience

1. Staff Data Engineer

   Crusoe

   Feb 2025 — Present · San Francisco, CA, US

   Built the Data Ingestion Platform as a Go-based event-driven service for internal event tracking enabling any engineering team to emit events with automatic buffering/batching, proto-driven schema registry, and custom Apache Beam Dataflow templates for real-time streaming from Pub/Sub to Hive-partitioned Parquet in GCS, achieving 80-90% storage reduction and 10-100x faster BigQuery queries.Own Crusoe\'s data infrastructure, including Terraform/IaC for Datastream (CDC for transactional databases), GCP log sinks, custom Dataflow jobs for log ingestion, VMetrics pipelines for time-series data from data centers, and stood up Airflow for orchestrated workflow scheduling.Built end-to-end data pipelines and analytics including dbt models for data transformations, implemented data ingestion using dlt, and created dashboards for VM/Storage capacity planning integrating VictoriaMetrics, PostgreSQL, and BigQuery to support forecasting, adoption and utilization.Mentor team members on data engineering best practices, lead architecture decisions, and drive cross-functional alignment on data platform initiatives

Education

• University of North Carolina at Charlotte

  Master's degree, Computer Science

  2018 — 2019

• Savitribai Phule Pune University

  Bachelor of Engineering (B.E.), Computer Science Engineering

  2013 — 2017