Sarthak Chopra
Data Engineer | Azure | Databricks | Spark | Python | SQL | Data Warehouse | PySpark | ETL
- Role
- Consultant (Data Engineer) at StatusNeo
- Location
- Delhi, DL, IN
- LinkedIn followers
- 500 followers
About Sarthak Chopra
Data Engineer with 4+ years of experience building scalable data pipelines and platforms that transform raw data into reliable, business-ready insights.Most of my work focuses on designing and optimizing ETL workflows using technologies such as Apache Spark, PySpark, Azure Databricks, Hadoop, Python, and SQL. The goal is always the same: to move and process large volumes of data efficiently while keeping systems reliable, scalable, and easy to maintain.At StatusNeo, I’ve worked on data platforms across industries including core banking, telecom and gaming. Some projects involved building customer analytics pipelines, others focused on migrating legacy SQL-based systems to Databricks workflows, designing scalable data models, or optimizing Spark jobs to improve performance and reduce processing time.Tech stack: Apache Spark | PySpark | Azure Databricks | Azure Data Factory | Azure Data Lake| Hadoop ecosystem | Python | SQL | Hive
Experience
Consultant (Data Engineer)
May 2023 — Present · Gurugram, IN
Data Analytics Platform (Gaming & Entertainment)- Created scalable Databricks workflows to extract and aggregate betting and user data for revenue projections, campaign strategies, and offer generation- Designed a generic framework to ingest data from diverse sources including third party S3 service, SQL Server databases and compressed csv files into ADLS. Implemented SCD Type 1 and Type 2 handling within the pipeline to maintain accurate historical tracking and ensure consistent data modeling for downstream analytics - Orchestrated and monitored Azure Data Factory pipelines for transactional and betting data ingestion- Transitioned legacy SQL Server (Azure VM) stored procedures to Databricks pipelines, utilizing delta tables for enhanced storage, performance and functionalities.P&L Automation (Telecom)- Automated several manual Excel processes and legacy Python scripts by developing modular Alteryx workflows with macros, creating a scalable pipeline for processing historical data and supporting revenue forecasting and business insights- Built a scalable data model as the foundation of an Insight Generation Engine (IGE), integrating multiple data sources such as SQL Server DB, system based structured and semi-structured generated files.
Education
Jaypee Institute Of Information Technology
Integrated M.Tech , Electrical, Electronics and Communications Engineering
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.