Anish Kumar Pandey
GCP Data Engineer | PySpark • Airflow • Hive • SQL | Big Data & ETL Specialist | Azure Certified (AZ-900)
- Role
- Executive - Data Engineer at Macquarie Group
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Anish Kumar Pandey
As a Data Engineer, I specialize in modernizing data ecosystems through on-prem to GCP cloud migrations. Working with some of the world’s leading enterprises, I help re-architect traditional data workflows into cloud-native, scalable, and cost-effective solutions along with supply of daily business needs.My core focus is building and migrating ETL pipelines from legacy systems (including Hive, Oracle, and DB2) to GCP services like BigQuery, Cloud Storage, and Dataproc, using a modern tech stack that includes PySpark, SQL, Hive, and Airflow (via Cloud Composer). These migrations are not just lift-and-shift—they involve reengineering the pipelines to align with cloud-first architecture, boost performance, and reduce operational overhead.I’ve designed and implemented automated, parameterized data pipelines that are easy to monitor, scale, and manage. Leveraging CI/CD tools and Git-based workflows, I ensure rapid, safe deployments with strong version control and rollback strategies. I also build in data validation, schema evolution handling, and checkpointing to ensure data integrity from source to target.In production environments, I focus on performance tuning, cost optimization (e.g, partitioning and clustering in BigQuery), and reliability through orchestration using Airflow DAGs, automated alerts, and logging frameworks. These efforts have significantly reduced runtime, improved error visibility, and increased system resilience.I’m also certified in Microsoft Azure Fundamentals, showcasing my cloud-agnostic mindset and continuous drive to stay at the forefront of modern data platforms.With a passion for clean code, automation, and solving complex data problems, I take pride in helping enterprises transform their data infrastructure and unlock faster, smarter decision-making through the power of cloud.
Experience
Executive - Data Engineer
Jan 2026 — Present · Gurugram, IN
Education
Oriental Institute of Science & Technology, Thakral Nagar, Opp Patel Nagar, Raisen Road, Bhopal-462021
Bachelor of Engineering - BE, Electronics and Communication
2016 — 2020
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.