Kashyap Patel
Data Engineer @ Parexel
- Role
- Data Engineer at Parexel
- Location
- Durham, NC, US
- LinkedIn followers
- 500 followers
Experience
Data Engineer
Feb 2025 — Present · NC, US
Delivered initial loads and CDC replication from Oracle to Databricks in Striim Cloud by configuring readers, targets, and checkpoints, and validating counts and checksums to keep analytics tables in sync.Reduced reconciliation time from days to hours by building an automated ADF pipeline and Databricks PySpark framework that executes Oracle to Delta queries and performs source to target comparisons at scale.Eliminated about manual metadata edits by generating table, view, and column descriptions with an OpenAI driven PySpark notebook that emits ALTER SQL files for bulk updates.Delivered curated Fact, RACT, and LMS tables with MERGE based incremental logic and optimized Delta Lake partitioning to improve downstream query performance.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.