Avi Juneja
Data engineer @ ZS Associates | Ex-Samsung | Knight @ Leetcode (1916 max) | Python, Pyspark, SQL, Dataiku DSS, ETL, Snowflake, Databricks
- Role
- Business Technology Solutions Associate at ZS
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Avi Juneja
Transforming Raw Data into Scalable Pipelines & Actionable Insights for Fortune 500 ClientsI’m a results-driven Data Engineer with ~2 years of experience building scalable ETL pipelines, cloud-based data solutions, and real-time reporting systems. I specialize in partnering with stakeholders to deliver end-to-end data engineering, warehousing, and automation solutions that create lasting business impact.Previously, I worked as an SDE Intern at Samsung SDS, contributing to e-commerce solutions and strengthening my software development fundamentals.I specialize in- Building and automating ETL pipelines for large-scale datasets- Workflow orchestration and real-time data processing- Developing scalable reporting & analytics dashboards- Data quality checks, validation frameworks, and process automationTech StackCloud: AWS (S3, Lambda, Glue)Data Engineering: PySpark, SQL, Python, Snowflake, Hive, Airflow, Dataiku DSS, DatabricksBI/Visualization: Tableau, Advanced ExcelData Analysis: NumPy, Pandas, MatplotlibVersion Control & Collaboration : Github, Git Let’s connect!I\'m always open to exciting opportunities in Data engineering and AI.Feel free to reach out to me at a••••••••@gmail.com
Experience
Business Technology Solutions Associate
Nov 2023 — Present · Gurugram, IN
Built and managed robust ETL pipelines using Apache Airflow, PySpark, and AWS Redshift, significantly reducing data refresh time by 38%, improving real-time availability of business-critical data.• Streamlined data ingestion and transformation workflows from multiple sources (Snowflake, S3, Redshift) by leveraging Spark optimizations such as broadcast joins, caching, and partition pruning.• Migrated legacy Python scripts and cron jobs to an event-driven AWS architecture, utilizing AWS Glue, Lambda to improve scalability, reduce cost, and eliminate single points of failure.• Engineered a Python-based utility to automate weekly ingestion of the latest client-uploaded files from Amazon S3, integrating with ETL workflows and saving 2+ hours of manual effort per week.• Automated complex business logic workflows in AWS Redshift using scheduled SQL jobs (daily, weekly, and quarterly), reducing manual interventions by 48% and ensuring consistent, error-free data processing.• Developed an automated email delivery pipeline in Dataiku DSS to distribute HTML-formatted HCP data to reps via real-time triggers.
Education
UIET Panjab University
Bachelor of Engineering - BE
2019 — 2023
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.