Rahul Reddy
Data Engineer | Azure | AWS | Python | SQL | PySpark
- Role
- Data Engineer at ABM Industries
- Location
- Milwaukee, WI, US
- LinkedIn followers
- 500 followers
About Rahul Reddy
I’m a Data Engineer with 5+ years of experience building scalable, high-performance data…
Experience
Data Engineer
Jan 2024 — Present · US
Orchestrated a real-time streaming pipeline by integrating Azure Data Factory with Event Hubs and Databricksfor transformations and ingested data into Azure SQL, cosmos DB, ADLS.• Optimized Databricks notebooks and jobs by utilizing (PySpark, sparkSQL) to process 20GB large datasetsand ingested data to Azure SQL and Blob storage for generating reports in PowerBI.• Integrated Azure Logic Apps and Azure Functions with Azure Monitor for real-time data pipelinemonitoring and alerting, resulting in a 30% improvement in issue resolution time.• Scheduled workflows in Apache Airflow, ensuring seamless transformation and resolving 100% issueschecking Airflow tools, logs, and corrective actions.• Orchestrated workflows in Databricks and migrated data to delta tables and utilized delta live tablesfor real time data processing and loading.• Designed Snowflake modeling in data warehousing, improving data cleansing by 25%, optimizing slowly changing dimension, enhancing change data capture and data validation.
Education
University of Wisconsin-Milwaukee
Master's degree
VIT_Vellore Institute of Technology
Bachelor of Technology - BTech
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.