Phani Morampudi
Data Engineer
- Role
- Aws Data Engineer at Broadway Bank
- Location
- Dallas, TX, US
- LinkedIn followers
- 500 followers
About Phani Morampudi
Experienced Data Engineer with over 5 years of expertise in designing and implementing…
Experience
Aws Data Engineer
Sep 2023 — Present · San Antonio, TX, US
Looked into existing Java/Scala spark processing and maintained, enhanced the jobs. Performed ETL operations using Python, Spark SQL, S3 and Redshift on terabytes of data to obtain customer insights. Worked on Ingesting data by going through cleansing and transformations and leveraging AWS Lambda, AWS Glue and Step Functions. Set up and worked on Kerberos authentication principals to establish secure network communication on cluster and testing of HDFS, Hive, Pig and MapReduce to access cluster for new users. Used Kafka functionalities like distribution, partition, replicated commit log service for messaging systems by maintaining feeds. Involved in loading data from rest endpoints to Kafka. Extensively used Data bricks spark and Jupyter notebooks for Data Analytics. Automated and monitored AWS infrastructure with Terraform for high availability and reliability, reducing infrastructure management time by 90% and improving system uptime. Developed Triggers, stored procedures, functions, and packagers using cursors associated with the project using PL/SQL. Built and configured Jenkins slaves for parallel job execution. Installed and configured Jenkins for continuous integration and performed continuous deployments. Worked on container orchestration tools such as Docker swarm, Mesos, and Kubernetes. Skilled in monitoring servers using Nagios, Cloud watch and using ELK Stack- Elastic search and Kibana. Conducted query optimization and performance tuning tasks, such as query profiling, indexing, and utilizing Snowflake\'s automatic clustering to improve query response times and reduce costs. Instantiated, created, and maintained CI/CD continuous integration & deployment pipelines and apply automation to environments and applications. Designed and deployed multi-tier applications using all AWS services (EC2, Route53, S3, RDS, DynamoDB, SNS, SQS, IAM) with an emphasis on high-availability, fault tolerance, and auto-scaling in AWS Cloud Formation.
Education
The University of Texas at Arlington
Master's degree
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.