Vijay

Data Engineer @Amazon

CA

Involved in building and maintaining second largest data lake for Amazon containing ~300 Petabytes of data for Advertisement business that would maintain legal and compliance policies.• Engineered aggregated datasets and metadata pipeline for SpektrBot, an LLM-powered GenAI chatbot tool using Claude 3 on AWS Bedrock with RAG architecture, serving monthly queries from data scientists and business teams.• Architected and implemented a scalable data availability monitoring system tracking datasets, significantly improving data delivery SLAs and customer satisfaction.• Migrated pipeline from batch-based processing which process ~1 TB of ad traffic data every hour to streaming with zero downtime and reduced the compute cost by $0.5MM per year.• Developed and maintained data pipelines integrating advertisement and retail datasets, enabling AI/ML models to generate actionable insights for SpektrBot\'s natural language query interface.• Reduced operational cost by 70% by automating the manual steps involved in maintenance of the pipelines. Built metrics and centralized dashboard that give clear visibility to leadership and customers.• Mentor engineers to understand best practices and guide them in career path.

University of North Carolina at Charlotte

Master’s Degree, Computer Science

Anna University Chennai

Bachelor’s Degree, Information Technology