Sai Vignan Ayancha
Data Engineer | Real-Time & Batch Data Pipelines | Cloud Lakehouse Architect (AWS, Azure, GCP) | Kafka, Spark, Flink | CI/CD & MLOps Specialist
- Role
- Data Engineer at Adobe
- Location
- San Francisco, CA, US
- LinkedIn followers
- 500 followers
Experience
Data Engineer
Feb 2025 — Present · San Francisco, CA, US
Architected and optimized real-time Apache Kafka & Spark Structured Streaming pipelines ingesting 100M+ monthly events (web, mobile, POS), reducing data latency to sub-second and enabling same-day personalized promotions that drove an 8.9% incremental basket lift• Designed and implemented a unified data model in Adobe Experience Platform to consolidate customer, order, and inventory schemas improving data quality by 30% and reducing ETL failure rates by 45%• Deployed AI-driven personalization inference pipelines with Adobe Sensei, achieving a 12% increase in onsite conversion rate and 15% uplift in average order value for Bay Area retail clients• Engineered batch ETL workflows using Apache Airflow and dbt alongside containerized data processing on Kubernetes/Docker, ensuring scalable, versioned deployments• Managed and optimized an end-to-end data lake on AWS, utilizing S3, Glue, and EMR for data processing and automating the infrastructure with Terraform to ensure cost-efficiency and high availability.• Built and maintained DevOps & CI/CD pipelines with Jenkins, GitLab CI, and Git for automated testing, code reviews, and zero-downtime rollouts of data workflows• Collaborated cross-functionally with solution architects, data scientists, product owners, and QA teams in agile sprints to define requirements, SLAs, and deliverables• Enforced data governance, GDPR/CCPA compliance, and PII protection through automated masking, consent management, and role-based access controls• Implemented DataOps best practices and observability frameworks (Grafana, Prometheus, ELK) for real-time metrics, anomaly detection, and SLA monitoring across pipelines• Developed ML Ops workflows and built scalable data Lakehouse architectures (Delta Lake, Apache Iceberg) to support unified batch and streaming analytics with Python, SQL, and Java.
Education
University of Alabama at Birmingham
Master's degree
Vasavi College of Engg
Bachelor of Engineering - BE
2017 — 2021
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.