Ismael de Freitas

Data Engineer @Neilson Financial Services

Windsor, GB

Contributed to a greenfield data migration project from SQL Server to Azure, supporting the design and execution of the migration process to ensure a smooth transition.• Engineered automated data retrieval processes using Python, Databricks, and Azure Data Factory (ADF) pipelines.• Applied PySpark for data transformation and modification to enhance processing efficiency• Designed, documented, and deployed data pipelines in Azure Data Factory, incorporating Change Data Capture (CDC) methodologies.• Integrated REST APIs to improve data connectivity and streamline ingestion processes across multiple time zones.• Retrieved data from various sources, including APIs, SFTP, and Azure Data Lakes, ensuring comprehensive data coverage.• Developed ETL processes and implemented STAR schema to optimize data retrieval and reporting efficiency.• Addressed data quality issues, ensuring data compliance with regulations and its fitness for use.• Collaborated with stakeholders, including data scientists, analysts and end-users, to gather and address data engineering requirements.• Actively contributed to greenfield projects, working from initial concept to fully operational data solutions.

Birkbeck, University of London

Master of Science - MS

The Open University

Bachelor of Science - BSc