Matthew Hamilton
Lead Data Platform Architect @National Energy System Operator
Signup · Get unlimited contacts
WORK HISTORY
Lead Data Platform Architect @National Energy System Operator
Wokingham, GB
Specifically brought in based on prior proven successes at Thames Water to rescue the Lakehouse implementation which had struggled to deliver a viable solution over the previous two years within a challenging environment. Within six months had completely re-architected the platform using the leading azure technologies to process data efficiently and utilise a rapid config driven approach. While in parallel re-organising the processes and people to support autonomous devops teams capable of delivering changes independently at a high frequency. This scalable, secure, modular platform could support analytics across the organisation, from business analytics teams using fabric and power bi to data scientists using machine learning sandboxes.Key responsibilities:• Spearheaded the tailored design and deployment end-to-end of the Azure Lakehouse medallion architecture, introducing the right technologies and ensuring they were implemented strategically to support the flexibility and speed of delivery demanded by the organisation.• Collaborated with cross-functional teams to define architecture and security standards for deploying cloud-based solutions adapted to the energy sector and the critical infrastructure requirements.• Championed the changes in people, process and technology in order for the organisation to be able to successfully adapt and take advantage of better delivery methods, supporting the teams through these transformations.Major Achievements:• Reshaping and delivering major changes to the Lakehouse within weeks of joining the organisation. Leveraging prior experience and working with the established teams to accomplish within a challenging organisation structure. • Drove the migration of the cloud data platforms to the new NESO tenancy without loss of service, while all the other systems were migrating in parallel. This required negotiating new patterns between the organisations leveraging and thinking laterally to overcome obstacles.
EDUCATION
Loughborough University
Computer Science and E-Business
ABOUT MATTHEW HAMILTON
As the Data Engineering and Platform Lead at a number of leading organisations, I have been instrumental in creating and managing a dynamic Azure data platforms that supports data science, data engineering and reporting solutions across the organisation. With over 20 years of experience in data engineering, enterprise architecture, and agile delivery, I have a proven track record of delivering complex and high-value data products for challenging clients in various industries, including telecommunications, finance, and utilities.The implementations leveraged Azure services—including Azure Data Factory (ADF), Logic Apps, Functions, Machine Learning, Data Lake, Event Hubs, Service Bus and Purview—as well as Databricks technologies such as DLT, Autoloader, and Unity Catalog, built on a Medallion architecture using Delta files. Designed reusable ETL/ELT pipelines to support both real-time and batch data ingestion, aligned with a data mesh approach to enable cross-functional analytics and machine learning use cases. This was maintained and managed using GIT repositories within Azure DevOps and CICD pipelines.My mission is to leverage the best of breed technologies and methodologies to enable data-driven innovation and transformation. I have architected the major blueprint, standards, and patterns for the Azure data platform, as well as led multiple scrum teams to deliver weekly changes into production. I have also collaborated with various stakeholders, teams, and organisations to ensure alignment, efficiency, and quality. I am passionate about data, technology, and leadership, and I am always looking for new opportunities to learn, grow, and contribute.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.