Parantap Banerjee

Associate Data Engineer @Tredence Inc.

Kolkata, IN

Designed and implemented a HIPAA-compliant, metadata-driven healthcare ingestion framework processing 50M+ Professional, Institutional, and Pharmacy claims records from AWS S3 and ADLS into governed Delta Lake architectures with schema enforcement, schema evolution, auditability, and scalable ingestion capabilities, reducing onboarding effort by 40%. Built scalable Bronze–Silver–Gold Lakehouse pipelines using Delta Live Tables (DLT) for Claims, Eligibility, Provider, Drug, and Member datasets, ensuring referential integrity, regulatory reporting reliability, and consistent downstream data consumption.Analyzed Payor source files and 100+ clinical and financial attributes to design scalable ER models and healthcare data architectures supporting claims, eligibility, member, and drug entities while meeting analytical and compliance requirements. Developed a configurable data profiling framework across 200+ tables incorporating null analysis, ICD/CPT validation, datatype verification, and financial range checks, accelerating anomaly detection and improving enterprise data quality visibility.Engineered a claims data quality engine enforcing 150+ business and compliance rules including eligibility validation, NPI validation, duplicate detection, and claim-line consistency checks prior to Silver-layer promotion, significantly improving reporting accuracy and reducing non-compliant data risks. Optimized large-scale PySpark workloads using partition optimization, broadcast joins, shuffle reduction, Z-ordering, and file compaction, reducing runtime by 30–40% and infrastructure costs by 20%. Integrated Git-based CI/CD pipelines enabling controlled Dev, QA, and Production deployments with audit traceability, version control, and standardized release governance across environments.

Jadavpur University, Kolkata

Bachelor of Engineering - BE

K.E Carmel School Amtala

ICSE

Birla High School

AISSCE, Science