Akhil B

Experience

1. Sr Aws Data Engineer & Etl Developer

   Delta Air Lines

   Apr 2023 — Present · Atlanta, GA, US

   As a Senior AWS Data Engineer at Delta Air Lines, I modernized legacy workflows, optimized cloud-based ETL pipelines, and enhanced real-time data processing. I migrated MS Access workflows to Informatica PowerCenter, improving data accuracy by 40%, and transitioned ETL processes to AWS Glue & Lambda, cutting costs by 35%. I designed event-driven ETL pipelines using AWS Glue, Lambda, Step Functions, and EventBridge, enabling real-time data ingestion.I optimized AWS Glue jobs with PySpark and partitioning strategies, reducing processing time by 50%. By enhancing Amazon Redshift performance through stored procedures, schema redesign, and workload tuning, I improved query performance by 60%. I automated job scheduling with Unix shell scripting, Control-M, and Cron, reducing manual intervention.I developed RESTful APIs using AWS API Gateway and Lambda for real-time data access and integrated AWS Lambda with S3, DynamoDB, RDS, and Redshift to streamline event-driven workflows. I implemented IAM role-based access, AWS KMS encryption, and data masking for compliance, and designed a centralized data lake using AWS Lake Formation, Glue Data Catalog, and S3.For monitoring, I built Python-based logging for AWS Glue and Lambda, leveraging AWS CloudWatch and X-Ray to enhance system observability. I developed MWAA (Managed Workflows for Apache Airflow) DAGs for complex ETL orchestration. I integrated AWS Kinesis Data Streams for real-time ingestion and containerized ETL microservices with Docker, deploying them on AWS ECS/EKS for scalability.I thrive in Agile environments, collaborating cross-functionally to deliver high-performance, cloud-native data solutions. Passionate about automation, optimization, and real-time analytics, I continuously push the boundaries of data engineering.#AWS #DataEngineering #ETL #CloudComputing #BigData #Automation #Python #SQL #Redshift #DeltaAirLines