Kushagra Singh

About Kushagra Singh

Google Cloud Professional Data Engineer with 2+ years building production-grade data pipelines at Accenture. Expertise in GCP (BigQuery, Cloud Functions, Pub/Sub), Azure Databricks, Delta Lake, PySpark ans Aws. Proven track record of optimizing data processing (35-40% runtime reduction), building 60+ DBT models, and implementing medallion architecture. Passionate about scalable lakehouse solutions and real-time streaming systems.

Experience

1. Data Engineer

   Accenture

   Apr 2024 — Present

   Architected and deployed production GCP data pipelines leveraging Cloud Functions, Pub/Sub, GCS, and BigQuery, enabling automated ingestion and transformation of 10M+ daily records• Engineered 60+ reusable DBT models with comprehensive testing suite and automated scheduling for Gold-layer analytics, improving data quality and reducing manual effort by 70%• Implemented end-to-end medallion architecture (Bronze-Silver-Gold) on Azure Databricks with Delta Lake for enterprise client, establishing data governance and quality frameworks• Developed optimized PySpark notebooks for data cleaning, enrichment, and incremental processing using Z-ordering and AQE, achieving 35-40% runtime reduction on 50GB+ datasets• Designed and deployed data quality scans in BigQuery and Databricks, implementing automated Python-based alerting via Cloud Functions and GitLab CI/CD pipelines• Optimized BigQuery performance through strategic partitioning/clustering and Databricks jobs using broadcast joins and caching, reducing query costs by 25%

Education

• Medicaps University

  Bachelor of Technology - BTech, Information Technology

  2019 — 2023

• Medicaps University

  Bachelor of Technology, Information Technology