Sharmila Guru

Experience

1. Senior Data Engineer

   Walmart

   Jan 2022 — Present · Sunnyvale, CA, US

   Built enterprise-scale data movement platforms using Apache Spark (Scala/Python) and Cassandra to support Walmart\'s personalization initiatives, processing terabytes of customer interaction data daily across distributed clusters• Designed and implemented high-performance feature stores leveraging Cassandra\'s distributed architecture and Spark processing engines to serve real-time personalization features to recommendation systems, reducing feature serving latency by 60%• Developed customer behavior analytics pipelines using Spark DataFrames and SparkSQL to process transactional and clickstream data from Walmart\'s e-commerce platform, enabling advanced customer segmentation for personalized shopping experiences• Engineered real-time data ingestion systems using Kafka and Spark Streaming to capture customer events and update Cassandra feature stores, supporting millisecond-level personalization decisions• Implemented scalable ETL workflows using Spark (Scala/Python) to transform raw customer data into actionable insights, integrating with Cassandra clusters for low-latency feature retrieval in production recommendation systems• Built robust data quality frameworks for personalization data pipelines, implementing automated validation and monitoring using Spark jobs to ensure data integrity across Cassandra keyspaces• Optimized Cassandra data models for personalization use cases, designing partition strategies and materialized views to support high-throughput read/write operations for customer profiles and product recommendations• Built interactive dashboards using Tableau and Looker to visualize customer behavior patterns and personalization metrics, enabling data-driven decision making for Walmart\'s marketing and product teams• Collaborated with cross-functional teams to translate business requirements into scalable data solutions, working closely with ML engineers to optimize feature engineering workflows for personalization models

Education

• Anna University Chennai

  Bachelor of Engineering - BE