Gangumalla Venkatesh
Data Engineer @IBM
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @IBM
Hyderabad, IN
Client: One of top 3 US Health Insurance ProviderTech Stack: Snowflake, GCP (Cloud Composer/Airflow, GKE, Dataflow, Pub/Sub), Python, SQL.Key Contributions:Architected Hybrid Pipelines: Designed and managed complex DAGs in Cloud Composer (Airflow) on GKE, integrating directly with Snowflake for seamless data loading.Performance Optimization: Optimized ETL job runtime by 30% through Snowflake clustering, partitioning, and warehouse sizing, handling datasets exceeding 50M+ rows.Real-Time Processing: Built near real-time ingestion pipelines using GCP Pub/Sub and Snowpipe, reducing data latency for critical dashboards.Dimensional Modeling: Implemented SCD Type 2 logic using complex SQL (CTEs, Window Functions) to track historical member data with 100% accuracy.Automation: Developed Python scripts to automate error detection, reducing manual intervention in the pipeline.
EDUCATION
National Institute of Technology Silchar
Bachelor of Technology - BTech
ABOUT GANGUMALLA VENKATESH
Data Engineer with 3.5+ years of professional experience specializing in Hybrid Cloud…
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.