Swarnim Jodh
GCP Data Engineer | 3+ Years Experience | BigQuery | Apache Airflow (DAGs) | Pub/Sub | Cloud Dataflow | Python | SQL | Pyspark | ETL/ELT Pipelines | Data Warehousing | Batch & Streaming Data | Immediate Joiner
- Role
- Data Engineer at Emtech Solutions
- Location
- Aurangabad, MH, IN
- LinkedIn followers
- 500 followers
About Swarnim Jodh
I am currently pursuing a Master’s in Digital Forensics at the renowned National Forensic…
Experience
Data Engineer
Jan 2024 — Present · Pune District, IN
As a Data Engineer, I design and maintain scalable data pipelines on Google Cloud Platform (GCP) to support analytics and data-driven decision making. I work with large datasets to build efficient ETL pipelines and optimize data workflows for reporting and business intelligence.• Built and maintained ETL/ELT data pipelines using Python and SQL for processing large-scale datasets.• Designed and orchestrated automated workflows using Apache Airflow (Cloud Composer) by creating and managing DAGs (Directed Acyclic Graphs) for reliable pipeline scheduling and monitoring.• Implemented real-time data ingestion pipelines using Google Cloud Pub/Sub for event-driven data processing.• Built scalable batch and streaming data processing pipelines using Cloud Dataflow.• Designed and optimized BigQuery data warehouses for large-scale analytical queries and reporting.• Created and optimized BigQuery Views and Materialized Views to improve query performance and reduce processing costs.• Implemented incremental loads, append loads, and MERGE/UPSERT operations in BigQuery for efficient data updates.• Developed ingestion pipelines that load raw data into Google Cloud Storage (GCS) and transform it into structured datasets for analytics.• Ensured data quality through validation, transformation, and monitoring of data pipelines.• Implemented monitoring, logging, and error handling using Cloud Logging and Cloud Monitoring to maintain pipeline reliability.GCP Services Used:BigQuery, Cloud Storage (GCS), Cloud Composer (Apache Airflow), Pub/Sub, Cloud Dataflow, Cloud Logging, Cloud Monitoring, IAM.Technologies:Python, SQL, ETL/ELT Pipelines, Data Warehousing, Data Modeling, Batch and Streaming Data Processing.
Education
Dr. Babasaheb Ambedkar Marathwada University, Aurangabad
Bachelors in Computer Application, Computer Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.