Pradeep Kumar
Data Engineer | Turning Data into Reliable Systems | 5 YOE | Master’s in CS | Specialized in Building End-to-End Data Pipelines.
- Role
- Senior Data Engineer at Bloomberg
- Location
- Aurora, IL, US
- LinkedIn followers
- 500 followers
About Pradeep Kumar
Most teams don’t fail because they lack data. They fail because their data systems aren’t reliable enough to trust. Broken pipelines, inconsistent metrics, and delayed reports slow down decisions and create friction across teams. I help organizations build dependable data pipelines so data becomes something teams can confidently act on at scale.I’m a Data Engineer with 5+ years of experience designing, building, and operating end-to-end data platforms across financial services and healthcare. I’ve owned batch and real-time pipelines processing billions of records daily, supporting analytics, reporting, risk, and regulatory use cases. Over time, my focus has shifted from just moving data to designing systems that are observable, resilient, and cost-efficient.My background includes working extensively with Python, SQL, Apache Spark, Kafka, Airflow, dbt, and Snowflake across AWS and Azure environments. I’ve built cloud-native data lakes and analytics platforms with a strong emphasis on data quality, performance, and operational reliability.What I do: Build and own end-to-end batch and streaming data pipelines. Design scalable data platforms for regulated, high-availability environments. Improve data reliability through validation, monitoring, and alerting, reducing pipeline failures by 50%. Optimize large-scale Spark and cloud workloads, cutting processing time by 40% and reducing infrastructure costs by millions annually. Deliver analytics-ready datasets used for reporting, risk analysis, and compliance.I enjoy working on data systems where accuracy, scalability, and trust matter. Open to connecting with engineers, data leaders, and teams building modern, reliable data platforms.
Experience
Senior Data Engineer
May 2024 — Present · Chicago, IL, US
Bloomberg provides real-time financial data, analytics, and news used by financial institutions worldwide. I work on large-scale data platforms that power analytics, risk, and decision systems at market speed.Roles & Responsibilities: Owned batch and real-time data pipelines processing 450B+ market data records per day, supporting analytics and risk workflows across Bloomberg products Built and operated streaming pipelines ingesting data from 300+ global exchanges, improving data freshness and reducing peak-hour latency by 30% Optimized Spark-based processing on AWS using EMR and EC2, reducing end-to-end processing time by 40% while improving overall platform throughput Improved data reliability by implementing validation, monitoring, and alerting, reducing production data incidents by 50% Tuned Spark partitioning and resource usage, improving query performance by 55% and reducing annual infrastructure costs by $5M
Education
CBIT
Bachelor's Degree, Computer Engineering
Lewis University
Computer Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.