Sai H.
Actively Looking for Job Data Engineer, Hadoop/Spark Developer | Big Data Engineer | Cloud & ETL Specialist | Spark, Hive, Kafka, Airflow | Python | SQL | AWS | GCP
- Role
- Data Engineer at PNC
- Location
- Charlotte, NC, US
- LinkedIn followers
- 500 followers
About Sai H.
Code. Build. Ship. Repeat. UNC Charlotte MS Computer Science |…
Experience
Data Engineer
Oct 2024 — Present · Pittsburgh, PA, US
Built end-to-end data pipelines using Apache Spark, Hive, Kafka, and NiFi to automate ingestion and processing across cloud-based data lakes. • Designed real-time streaming workflows using Spark Streaming and Apache Hudi to enable low-latency capital market analytics. • Migrated on-premise legacy systems to GCP BigQuery, optimizing data queries and reducing reporting lag by 35%. • Automated ETL job scheduling with Airflow and AWS Glue, streamlining recurring tasks with minimal manual effort. • Monitored Kubernetes (EKS) Spark jobs with Grafana and integrated unit testing using PyTest and ScalaTest. • Developed dashboards using Tableau and SQL/Athena to visualize key performance metrics for trading and risk teams. • Collaborated cross-functionally with cloud and data governance teams to ensure pipeline reliability and compliance.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.