Harshit Agarwal
Senior Data Architect | Cloud, GenAI, Azure, Fabric & Databricks
- Role
- Senior Associate - Data Engineering L2 at Publicis Sapient
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Harshit Agarwal
Senior Data architect with 11+ years of experience designing and owning cloud scale, high-performance data platforms across healthcare, IoT, finance, and consumer analytics domains. Specialized in Azure Databricks and Microsoft Fabric Lakehouse architecture, distributed data processing, real-time streaming, and API optimized data systems, handling billions of records. Proven ability to translate complex business problems into scalable, secure, & cost-efficient platforms with strict latency and reliability SLAs.
Experience
Senior Associate - Data Engineering L2
Mar 2024 — Present · Gurugram, IN
Client: UnitedHealth Group (UHG)Project: Clinical Orchestrator & Identity Management Data Engineering• Developed a robust identity management solution that assigns a unique identifier to individuals, leveraging Delta Tables and Apache Spark on Azure Cloud and Azure Databricks.• Architected and optimized high-performance data pipelines capable of processing terabytes of data and billions of records, ensuring scalability, reliability, and efficiency in a distributed system.• Designed & imposed several processes in the platform – data hygiene, cross chain matching, enrichment & consolidation.• Designed a data model to replicate the existing Delta tables data in a PostgresSQL database, enabling faster data access through indexing and seamless consumption by APIs. Data Science• Developed a data-driven solution to enhance consumer experience by utilizing sanitized identifiers for targeted marketing campaigns, enabling precise audience segmentation, personalized recommendations, and improved engagement through data-driven insights.• Implemented a rule-based identity resolution system to accurately detect and link multiple identities belonging to the same individual, ensuring data integrity, reducing duplication.
Education
Indian Institute of Technology, Roorkee
Master's Degree, Electric Drives & Power Electronics
2013 — 2015
Dehradun Institute of Technology
Bachelor's degree, Electrical Engineering
2008 — 2012
Army School Hempur
Higher Secondary Examination, High School/Secondary Certificate Programs
2007 — 2008
Skills
- Cassandra
- Nosql
- Apache Spark
- Electrical Engineering
- Solr
- Jdbc
- Esper
- Apache Kafka
- Big Data
- Sql
- Restful Webservices
- Java
- Arduino
- Electric Drives
- Hbase
- Power Electronics
- Scala
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.