Saikiran Adepu

Sr Cloud Engineer @Vanguard

Malvern, PA, US

Designed and implemented ETL pipelines using AWS Glue to run SQL queries on S3 data sources, transforming and writing processed data to target S3 buckets and Collibra Data Market place.• Utilized Troposphere to programmatically generate CloudFormation templates (CFT) for AWS resources, enabling repeatable and automated infrastructure provisioning.• Utilized AWS Athena to perform data validation on datasets stored in S3, ensuring data accuracy and consistency for downstream processes.• Optimized data validation processes in S3 by leveraging AWS Athena’s policy limits to ensure efficient query execution and cost management.• Configured and monitored EMR clusters for large-scale data processing, implementing Spark and Hadoop jobs to streamline big data workloads.• Automated IAM policy generation and deployment using Python scripts, reducing manual errors and improving efficiency.• Supported the RDW migration from Db2 to AWS Redshift and S3 by assisting in data extraction, transformation, and validation to ensure successful transitions.• Implemented AWS Event Bridge (formerly CloudWatch Events) to create event-driven architectures, automating responses to detect anomalies or any job failures and triggering AWS Lambda functions / SNS for real-time actions.• Integrated GitHub and Bitbucket repositories into automated pipelines to ensure consistent code quality and streamlined version control.

Stratford University

Masters in Software Engineering , Computer Software Engineering

Jawaharlal Nehru Technological University

Bachelor's degree, Mechanical Engineering