Suresh Reddy

Experience

1. Sr Data Engineer

   Kaiser Permanente

   Dec 2022 — Present

   Collaborated with Health Partners Plan stakeholders to understand data requirements, objectives, and business goals.Designed, developed, and maintained scalable data pipelines and workflows using Azure Data Factory (ADF),Ensuring efficient data ingestion, transformation, and loading (ETL) processes.Implemented data integration solutions to extract, transform, and load healthcare data from various sources into Azure data storage solutions, such as Azure Data Lake Storage or Azure SQL Data Warehouse.Utilized Azure Data bricks Spark for processing and analyzing large volumes of healthcare data, optimizing data pipelines for performance and scalability.Developed and optimized Spark-based data processing scripts and applications using Scala and Python, ensuring code efficiency and maintainability.Implemented FHIR/HL7 standards to develop flexible data exchange solutions, enabling seamless interoperability across diverse healthcare information systems, while serving as a Data Engineer at Health Partners Plans.Collaborated with data scientists and analysts to implement advanced analytics solutions using Spark MLlib and other machine learning libraries within Azure Databricks.Implemented data quality checks and validation procedures to ensure the accuracy, consistency, and reliability of healthcare data stored in Azure data lakes and data warehouses.Configured and managed data security measures, including encryption, access controls, and compliance with HIPAA and GDPR regulations, in collaboration with Health Partners Plan\'s security and compliance teams.Designed and implemented CI/CD pipelines using Jenkins on Azure, automating the deployment, and testing of data engineering workflows and applications.Worked closely with Health Partners Plan\'s IT and operations teams to troubleshoot issues, optimize performance, and ensure the reliability of data engineering solutions.