Imran A.
Data Engineer @Halfords
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Halfords
Developed and maintained scalable ETL pipelines in Databricks using Spark, Python, and SQL, implementing the Medallion architecture across Bronze, Silver, and Gold layers.• Owning the end-to-end technical data lifecycle and corresponding data technology stack.• Leveraged metaprogramming with Databricks Delta Live Tables (DLT) to automate data transformations and streamline pipeline deployment.• Implementation of data pipelines through Databricks new lakeflow connection architecture.• Worked closely with data team leadership to optimise Azure data infrastructure by reducing compute and storage costs in Azure Data Factory and Azure Databricks, and redeploying data pipelines with improved performance and lower time complexity.• Architected and optimised end-to-end data solutions using Azure services, including Data Factory (ADF), Data Lake Storage, and Key Vault, while integrating CI/CD pipelines for efficient deployment and infrastructure management.• Implemented a complete rebuild of CI/CD actions in Github.• Configured and tuned Databricks compute clusters to support high-performance, scalable data workflows.• Built automated SQL alerting workflows for real-time monitoring and diagnostics across ETL and data pipelines.• Managed source control using Azure DevOps, GitHub and Git, following Gitflow best practices to create, review, and approve pull requests (PRs), ensuring code quality and deployment consistency.• Collaborated with cross-functional teams including data and business analysts, engineers, and product managers and data scientists to enhance data workflows and deliver actionable business insights.
EDUCATION
University Of Central Punjab
Bachelors of science in Computer Sciences, Mathematics and Computer Science
Robert Gordon University
Master of Science - MSc, Data Science
Kipschool
Matric, Computer Sciences
Punjab College of Information Technology
Intermediate, Computer Science
ABOUT IMRAN A.
Passionate about harnessing the power of data technology to solve real world problems, I thrive in a collaborative environment where creativity and technical expertise intersect. I am dedicated to continuous learning and staying at the forefront of technological advancements to deliver innovative solutions and drive impactful results.As a professional with a robust background in Software, Data engineering and Data Science. My experience spans from developing data models, data pipelines, machine learning models and crafting low cost high performance software solutions.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.