Dheeraj Borlla
Data Engineer | Python, SQL, Spark, Airflow | BigQuery, Snowflake | ETL/ELT | Cloud (GCP/Azure) | Scalable Pipelines | Data SRE | Transforming Data into Strategic Assets
- Role
- Data Engineer at American Express
- Location
- Phoenix, AZ, US
- LinkedIn followers
- 500 followers
About Dheeraj Borlla
I’m a Data Engineer with 7+ years of experience building and operating scalable…
Experience
Data Engineer
Feb 2023 — Present · Phoenix, AZ, US
Designed and maintained scalable data pipelines using Airflow and BigQuery to support real-time analytics and reporting.• Collaborated with a cross-functional teams to build a metadata driven Spark streaming platform for consuming data from real time streaming platform (Kafka) and loading to Hive.• Built an automated monitoring solution using Python to track Kafka-to-Hive ingestion, sending real-time alerts via email and Slack when anomalies or ingestion failures occur.• Improved system reliability and platform performance by implementing proactive monitoring and alerting using OpenSearch & Kibana.• Automated operational workflows with Python & Bash, reducing manual intervention by 60% and improving MTTR. Collaborated with the platform and Data Engineering teams to meet SLAs and SLOs.• Collaborated with stakeholders to define KPIs and build dashboards on Kibana & OpenSearch to visualise system metrics and to support Root Cause Analysis & Capacity planning.• Conducted in-depth root cause analysis (RCA) and implemented long-term fixes to reduce incident frequency.• Preparing documentation for logging issues and creating run books for the team to support when encountering such scenarios.• Developed and maintained a comprehensive Disaster Recovery plan and executed annual recovery drills to ensure system resilience.
Education
The University of Texas at Dallas
Master's degree
2016 — 2017
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.