Adam Idris
Associate Data Scientist Python, Machine Learning, Databricks, Eda, Sql @Anglian Water Services
Signup · Get unlimited contacts
WORK HISTORY
Associate Data Scientist Python, Machine Learning, Databricks, Eda, Sql @Anglian Water Services
Peterborough, GB
Programming in Python on Databircks for data-driven solutions. Experienced in anomaly detection, machine learning model development, and data analysis. Skilled in extracting data from diverse sources (GraphQL, REST APIs, JSON) and building automated workflows.Key Projects:PRV Anomaly Detection:• Engineered an Databricks pipeline in Python to extract and process over data points from multiple PRV sites from RESTful and GraphQL APIs, accross four data streams: upstream, downstream, control space pressure, and flow rate.• Automated the workflow to run weekly and append all the valid and invalid PRVs to separate tables, resulting in complete elimination of manual processing time.• Developed a robust supervised learning model with XGBoost, achieving a 90% overall accuracy and an f1 score of 0.96 with XGBoost to identify malfunctions PRV malfunctions based on the various datastreams.Dynamic Thresholds:• Implemented a machine learning model on Databricks, utilising Prophet for water pressure forecasting, accounting for seasonal variation and external factors, achieving an overall accuracy of 93%.• Integrated Isolation Forest for anomaly detection to dynamically apply warning and critical thresholds for pipe burst prevention.Risk Model:• Evaluated an original risk anomaly detection system, identifying three critical enhancements. Took over the project seamlessly, through collaboration and knowledge transfer with prior leads to revamp code and migrate workflow to Databricks; increasing accuracy by 20%.Optimatics:• Automated data extraction and processing by creating a Python script to handle JSON files, generating concise data summaries in spreadsheet format with a complete reduction in manual workload.
EDUCATION
AiCore
Data Science
Delft University of Technology
MSc, Applied Geophysics
Alma Mater Studiorum – Università di Bologna
BSc, Applied Geosciences
ETH Zürich
MSc, Applied Geophysics
German University of Technology in Oman
BSc, Applied Geosciences
RWTH Aachen University
MSc, Applied Geophysics
ABOUT ADAM IDRIS
As a Data Scientist at Anglian Water Services, I specialise in designing and delivering…
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.