Sai Vinay
Senior Data Engineer @Cox Automotive Inc.
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @Cox Automotive Inc.
Austin, TX, US
Gathered business requirements, worked closely with business users, project leaders and developers and analyzed the business requirements, designed data models, analyzed existing systems, and propose improvements in processes.• Performed end- to-end Architecture & implementation assessment of various AWS services like Amazon EMR, Redshift, S3, Athena, Glue and Kinesis. • Hive As the primary query engine of EMR, we have built external table schemas for the data being processed. AWS RDS (Relational database services) was created to serve as a Hive meta store, and it was possible to integrate the meta data from 20 EMR clusters into a single RDS, avoiding data loss even if the EMR was terminated. • Involved in the development of a shell script that collects and stores logs created by users in AWS S3 (Simple storage service) buckets. This contains a record of all user actions and is a good indicator of security to detect cluster termination and safeguard data integrity. • Partitioning and Bucketing ideas were implemented in the Apache Hive database, which increases query retrieval performance. • Designed and implemented scalable and cost-effective cloud architectures on AWS to meet specific data processing and storage requirements.• Utilized AWS Well-Architected Framework principles for building reliable, secure, and efficient systems.• Developed and deployed serverless ETL pipelines using AWS Lambda functions, optimizing resource usage and reducing operational overhead.• Leveraged AWS Step Functions to orchestrate serverless workflows, ensuring seamless coordination of distributed tasks.• Configured AWS CloudWatch for monitoring and logging, creating custom dashboards to track key performance indicators and system health.
EDUCATION
Jawaharlal Nehru Technological University
Bachelor of Technology - BTech, Electrical, Electronics and Communications Engineering
ABOUT SAI VINAY
Motivated Data Engineer having 10+ years of professional experience in Data Engineering, Analytics, DataModeling, Data Science, Data Architecture, Programming Analysis and Database Design of OLTP andOLAP systems with sound knowledge in Cloud Technologies (AWS, Azure).• Domain expertise in E-commerce, Healthcare, Enterprise Systems, Financial Sector. Skilled in workingwith cross-functional teams to design, develop and implement data-driven solutions with large data sets tosolve complex business problems and executed data-driven action-oriented solutions with StorytellingCapabilities using agile methodologies.• Performed data engineering functions: data extraction, transformation, loading, and integration to supportenterprise data infrastructures - data warehouse, operational data stores, and master data management.• Good experience in creating and designing data ingest pipelines using technologies such as ApacheStorm- Kafka and Experienced in writing live Real-time Processing using Spark Streaming with Kafka asa data pipeline system.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.