Harsh Singh
Data Engineer | GCP (BigQuery, Dataflow) | SQL, Python, Spark, Airflow | ETL & Data Pipelines
- Role
- Gcp Data Engineer at HT Digital Streams
- Location
- New Delhi, DL, IN
- LinkedIn followers
- 500 followers
About Harsh Singh
As a Data Engineer, I design and optimize Medallion architectures in BigQuery to enhance…
Experience
Gcp Data Engineer
Feb 2024 — Present · IN
Designed a Medallion architecture (Bronze/Silver/Gold) in Big Query, optimizing storage (partitioning/clustering) and queries to cut scan size ~40% and improve runtime.2. Built and orchestrated fault-tolerant ETL/ELT from APIs, CRMs, MongoDB → BigQuery using PySpark, Dataflow, Airflow, Cloud Functions with automated monitoring/alerts to reduce downtime.3. Designed and deployed end-to-end data pipelines to ingest and process data from multiple third-party sources (e.g, Taboola, Google Search Console, GA4 API, vendor REST APIs, SEO tools) into BigQuery, using Cloud Functions, Airflow, Python (requests, Selenium), and scheduling frameworks to support near-real-time ingestion, monitoring, and scalable data ops.Tech used: Python, SQL, GCP (Big Query, Dataflow, Cloud Functions, GCS), Airflow, PySpark, GA4, Looker Studio, REST APIs, Selenium, CI/CD, Git, Jira.
Education
Chhatrapati Shahu Ji Maharaj University
Bachelor of Technology - BTech
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.