Abdalla Abdelrahman

About Abdalla Abdelrahman

I am a skilled data engineer with expertise in designing and building data pipelines on various cloud platforms, including Azure and AWS. With a focus on healthcare data, I have a deep understanding of medical data, CPT codes, providers, and billing structures. My experience encompasses working with diverse medical datasets, unpacking MRFs, and leveraging advanced analytics to derive actionable insights.In my career, I have successfully designed and implemented data pipelines using Azure Data Factory, Azure Databricks, AWS EMR, and AWS Glue. I excel at orchestrating end-to-end data workflows, integrating with different data sources, and ensuring data quality and reliability throughout the process. By leveraging these technologies, I have enabled organizations to efficiently process and analyze large-scale data, unlocking valuable insights for improved decision-making and operational efficiency.I possess strong expertise in relational database design, schema development, and index optimization, ensuring optimal performance and data accuracy. Additionally, I am adept at documenting my work, capturing project details, challenges faced, and solutions implemented. My ability to create clear and concise documentation, including diagrams and technical specifications, facilitates seamless knowledge transfer and collaboration among team members.With a passion for data engineering and a focus on the healthcare domain, I am driven to deliver innovative solutions that enhance data processing, analysis, and decision-making within the industry. I thrive in collaborative environments, leveraging my strong communication and problem-solving skills to work effectively with cross-functional teams.If you are looking for a data engineer with expertise in medical data, cloud platforms, and building robust data pipelines, I invite you to connect with me. Let\'s explore how we can leverage data to drive meaningful outcomes and achieve business success.

Experience

1. Data Engineer

   Handl Health

   Oct 2022 — Present

   Designed and developed end-to-end data pipelines using Azure Databricks, AWS EMR, AWS Glue, and PySpark to process and transform large volumes of data for analytics and reporting purposes. Implemented data ingestion processes from various sources, including databases, APIs, and flat files, ensuring data integrity and quality. Leveraged Pandas for data manipulation and cleaning tasks, performing exploratory data analysis to identify trends, anomalies, and insights. Collaborated with cross-functional teams to gather requirements, understand data needs, and deliver customized solutions to meet business objectives. Optimized data processing workflows by fine-tuning Spark configurations, partitioning strategies, and utilizing cluster resources efficiently. Implemented data governance and security measures to ensure compliance with industry standards and regulations. Integrated AWS services, such as S3, EMR, Lambda, and Athena, to build scalable and cost-effective data processing solutions in the AWS ecosystem. Utilized Azure services, including Azure Data Factory and Azure Databricks to design and deploy data pipelines in the Azure cloud platform. Created data models and schemas to support efficient data storage, retrieval, and analysis, ensuring data consistency and accuracy. Documented data processes, workflows, and system configurations to facilitate knowledge sharing and ensure maintainability.

Education

• University of Windsor

  Bachelor's degree, Mechanical Engineering

  2017