Rajesh Kumar Pallapothu
Senior Data Engineer | AWS, PySpark, Apache Spark, AWS Glue, Lambda, EMR, Python, ETL, Hive, C++, Unix/Linux, SQL, AWS Professional Solution Architect Certified, Data Engineering, Cloud
- Role
- Senior Data Engineer at Wabtec Corporation
- Location
- Palm Bay, FL, US
- LinkedIn followers
- 500 followers
About Rajesh Kumar Pallapothu
With over 14 years of experience in IT, including more than 7 years as a Senior Data Engineer at Wabtec Corporation, I specialize in designing, automating, and optimizing scalable Big Data pipelines within AWS cloud environments. My expertise spans ETL/ELT development using PySpark, Spark, and AWS services such as Glue, Lambda, EMR, StepFunctions, and Redshift. I contribute to transforming large, complex datasets into actionable insights while ensuring performance, reliability, and cost efficiency. At Wabtec Corporation, I collaborate within an Agile environment to enhance data-driven railroad analytics by implementing serverless automation and optimizing distributed data pipelines. My technical proficiency in Python, Hive, and SQL, combined with AWS certifications, reflects my commitment to delivering efficient and scalable data engineering solutions that drive operational excellence.
Experience
Senior Data Engineer
May 2019 — Present · FL, US
Data Engineer working on a data-driven railroad analytics platform, building scalable Big Data pipelines on AWS. Design and develop ETL/ELT workflows using PySpark, Spark, and DBT to ingest, transform, and process large datasets from multiple sources into S3, Hive, and Redshift. Implement serverless automation with AWS Lambda and Python to enable event-driven data processing and improve operational efficiency. Optimize distributed data pipelines for performance, reliability, and cost efficiency while collaborating with cross-functional teams in an Agile environment.
Education
Jawaharlal Nehru Technological University Hyderabad (JNTUH)
B.Tech, Computer Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.