Sai Gannoju

Gcp Data Engineer @Walmart Global Tech

Sunnyvale, CA, US

PROJECT DESCRIPTION: Working as Data Engineer in MSC CRM Engineering team, that is responsible for Planning and Executing the marketing campaigns that involve push and email notifications to engage with customers using customer data sets and segmentation techniques to identify and target specific Customer groups.KEY ACHIEVEMENTS & IMPACT METRICS: Designed and transformed US-based AI Platform to marketplace-agnostic architecture supporting global market tenants across multiple international markets, maintaining core functionalities like user features, frequency capping, model scoring and message uniqueness Improved Airflow pipelines to reduce processing times for 650+ million records daily, achieving 40%-50% performance optimization through parallel processing and resource allocation strategies Implemented cloud cost optimization strategies saving $250K+ annually through resource rightsizing, automated scaling policies, and efficient data storage tiering Achieved 35% improvement in customer engagement through data-driven targeting Processed 10TB+ daily customer data with 99.9% pipeline reliability Reduced campaign deployment time from 24 hours to 6 hours through Proper Airflow Configuration and Pipeline Management.RESPONSIBILITIES:Working with cloud-based technologies in Google Cloud Platform (GCP) such as BigQuery for data storage and processing. Responsible for designing, building, Managing and Monitoring of data pipelines workflows using Airflow. This involves writing code to extract data from various sources, transform and clean it, and load it into Hive Database and BigQuery and ensuring the reliability and data integrity. Developing and maintaining data processing workflows using Spark Streaming for real-time data processing. ENVIRONMENT & TOOL STACK: Python, GCP, Spark, Scala, Cloud Monitoring, Airflow, Kafka, Hive SQL, Big Query, ETL, Kafka Streaming, Spark SQL, UAT Testing, HA/DR

Lindsey Wilson University

Master of Science - MS