Surya Kondapalli
Data Engineer at Amazon
- Role
- Data Engineer at Amazon
- Location
- Seattle, WA, US
- LinkedIn followers
- 500 followers
About Surya Kondapalli
Highly accomplished Data Engineer with 5+ years of progressive experience in architecting…
Experience
Data Engineer
Dec 2022 — Present · Seattle, WA, US
Designed and setup Enterprise Data Lake to provide support for various uses cases including Storing, processing, Analytics and Reporting of voluminous, rapidly changing data by using various AWS Services.* Used various AWS services including S3,EC2, AWS Glue, Athena, RedShift,EMR.* Extracted data from multiple source systems S3, Redshift, RDS and Created multiple tables/databases in Glue Catalog by creating Glue Crawlers.* Created AWS Glue crawlers for crawling the source data in S3 and RDS.* Created multiple Glue ETL jobs in Glue Studio and then processed the data by using different transformations and then loaded into S3, Redshift and RDS.* Created multiple Recipes in Glue Data Brew and then used in various Glue ETL Jobs.* Design and Develop ETL Processes in AWS Glue to migrate data from external sources like S3, Parquet/Text Files into AWSRedshift.* Used AWS glue catalog with crawler to get the data from S3 and perform SQL query operations using AWS Athena.* Written PySpark job in AWS Glue to merge data from multiple tables and in Utilizing Crawler to populate AWS Glue data Catalog with metadata table definitions.* Used AWS Glue for transformations and AWS Lambda to automate the process.* Used AWS EMR to transform and move large amounts of data into and out of AWS S3* Created monitors, alarms, notifications and logs for Lambda functions, Glue Jobs using CloudWatch.* Performed end-to-end Architecture & implementation assessment of various AWS services like Amazon EMR, Redshift and S3.* Used AWS EMR to transform and move large amounts of data into and out of other AWS data stores and databases, such as Amazon Simple Storage Service (Amazon S3) and Amazon DynamoDB.* To analyze the data Vastly used Athena to run multiple queries on processed data from Glue ETL Jobs and then used QuickSight to generate Reports for Business Intelligence.* Used AWS EMR to transform and move large amounts of data into and out of AWS S3.
Education
Sreenidhi Institute of Science and Technology
Bachelor of Technology, Computer Engineering
Sreenidhi Institute of Science and Technology
Bachelor's Degree, Computer Engineering
University of Cincinnati
Master's Degree, Computational Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.