Pranay Kumar

Experience

1. Data Engineer

   Cardinal Health

   Jan 2024 — Present · US

   Developed and maintained scalable Azure Data Factory pipelines using Apache Spark and Python to efficiently process and transform large volumes of patient health records and claims data, ensuring seamless data integration and preparation. • Streamlined and automated data processing workflows, reducing processing times by 50% and ensuring timely and accurate reporting, which contributed to more efficient operational management. • Utilized MongoDB for storing and managing unstructured healthcare data, such as patient health records and claims data, enabling flexible schema design and efficient querying for large-scale datasets. • Leveraged PySpark within Azure Databricks to perform complex data transformations and aggregations, ensuring efficient processing and accurate data preparation. • Employed Hive as a data warehousing solution to store and manage structured healthcare data, supporting complex analytical queries and reporting needs. • Managed infrastructure lifecycle using Terraform to ensure the automated creation, updating, and versioning of Azure resources, facilitating smooth deployments and maintaining the integrity of healthcare data pipelines. • Developed and maintained data orchestration workflows using Apache Airflow, automating the scheduling and execution of complex data pipelines for healthcare data integration, transformation, and reporting.