Sandeep Birudukota
Software Development Engineer | 5 Years Experience | San Jose State University | MS in Software Engineering | Ex-TCS
- Role
- Data Engineer at Deloitte
- Location
- San Jose, CA, US
- LinkedIn followers
- 500 followers
About Sandeep Birudukota
Data Engineer with over 4+ years of experience in Building scalable data pipelines and…
Experience
Data Engineer
Mar 2024 — Present · US
Enhanced AWS infrastructure by automating resource provisioning using Infrastructure as Code (IaC), resulting in a 50% drop-in deployment time and significantly improving overall operational efficiency.•Designed an end-to-end streaming pipeline utilizing Apache Spark and Kafka, which enabled the processing of events per minute, with PySpark facilitating streamlined data transformations for real-time applications.•Integrated various AWS services, including S3 for data storage, AWS Glue for ETL processes, and Amazon Redshift for data warehousing, using CTEs in SQL to enhance the readability and maintainability of complex queries.•Developed PySpark scripts in AWS Glue to reshape schemas and enrich data. Additionally, using Pandas to efficiently manipulate and clean datasets before loading into databases.•Leveraged AWS Glue and AWS Athena for data transformations and ad-hoc querying, providing stakeholders with real-time insights. SQL techniques were employed to effectively query data stored in S3.•Streamlined the deployment process via Docker integration and empowered data-driven decisions by providing clean, transformed data to analysts for use in Power BI, enabling the creation of dynamic visualizations.
Education
Sri Kakatiya Merit School
Primary education
Sri Chaitanya Junior College
Intermediate, MPC
San José State University
Master's degree, Computer Software Engineering
SRKR Engineering College
Bachelor of Technology - BTech, Computer Science
2015 — 2019
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.