Akhil Reddy M

Data Cloud Engineer @Walmart

Dallas, TX, US

Architected pipelines across AWS + GCP ingesting and transforming 10B+ daily operational and clickstream events spanning 5TB+ of data with idempotency and replay guarantees.• Tuned PySpark for production workloads by mitigating data skew, optimizing shuffle partitions, and enabling adaptive execution—reducing heavy queries by 45% and tightening P99 latency.• Built ETL workflows with Airflow/Cloud Composer supporting standardized retries, checkpointing, lineage tracking, and schema evolution—cutting operational intervention by 60%.• Engineered a high-concurrency vector search pipeline using Pinecone + embedding generation to power a retail RAG system; selected a vector DB over dense BM25 lookup to win on personalization latency despite 50% lower fan-out and higher memory footprint.• Implemented FinOps controls across BigQuery workloads, leveraging clustering, partition pruning, and caching to reduce compute consumption by 35%.• Enabled platform reliability for 20+ internal consumers through automated alerting, dependency graph validation, and self-serve runbooks.