Sanjay Verma
Sr. Data Engineer at Xebia | Ex - {Pine labs, Amazon MX Player} | NIT Allahabad
- Role
- Senior Data Engineer at Xebia
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Sanjay Verma
About MeI\'m a Data Engineer with 6+ years of experience designing, building, and optimizing large-scale data pipelines across cloud and on-premise platforms. My core expertise includes Apache Spark, PySpark, Scala, SQL, and AWS, with a strong focus on delivering scalable ETL/ELT solutions, migrating legacy systems to modern platforms like Databricks, and enabling real-time analytics for high-volume systems.I’ve worked on optimizing clickstream pipelines processing ~6 billion records (3 TB datasets), migrated API-based ingestion workflows, and improved pipeline performance by up to 60%. Skilled in both batch and streaming data processing (Kafka, Spark Structured Streaming), I leverage distributed computing and parallel processing to drive efficiency and scalability.I have always been passionate about exploring new techniques. Learning new concepts fuels me to think of innovative ways to solve problems and continuously improve existing solutions. I actively look for better approaches to optimize and modernize data pipelines for enhanced performance and cost efficiency. Key Skills: Spark, PySpark, Scala, SQL, AWS (EMR, S3, Redshift, Glue), Databricks, Airflow, dbt, Kafka, ADF, Azure, Power BI, Tableau Current Focus: Building scalable data pipelines on Databricks, Spark performance tuning, dbt model development, and optimizing API-based data ingestion pipelines for advanced analytics.
Experience
Senior Data Engineer
Oct 2025 — Present · Gurugram, IN
Education
Motilal Nehru National Institute Of Technology
Master of Computer Applications, Computer Science
2016 — 2019
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.