Martin Baker

Data Engineering Manager @Asda

GB

Manage a team responsible for maintaining and managing the existing data infrastructure.\\\\n• Lead the data migration efforts into a new Databricks lakehouse, ensuring a seamless transition.\\\\n• Utilize tools such as SQL, Python, GIT Hub, Databricks and other data analytics & engineering tools & techniques to optimize data processes.\\\\n• Validate and ensure the accuracy of data in the bronze layer of the new Data Ecosystem.\\\\n• Collaborate with cross-functional teams to capture and address reporting reporting requirements.\\\\n• Engineer robust data pipelines using technologies like Apache Spark, Kafka, and Airflow.\\\\n• Architect scalable and reliable data pipelines that efficiently extract, transform, and load data.\\\\n\\\\nAchievements\\\\n Successfully led the migration of data from legacy systems to a new Databricks lakehouse, minimizing downtime and ensuring data integrity.\\\\n Implemented data validation processes that significantly improved the accuracy and reliability of data in the bronze layer.\\\\n Streamlined data processes using SQL, Python, GIT Hub, Databricks, and other data analytics & engineering tools & techniques, resulting in improved efficiency and reduced processing time.\\\\n Collaborated with business teams to capture their reporting requirements and implemented data solutions that met their needs, enhancing overall data-driven decision-making capabilities.\\\\n \\\\n\\\\n \\\\n \\\\n\\\\n \\\\n

Stanmore college

BTEC NATIONAL