Hitesh Chouhan
Staff Platform Engineer @bp
Signup · Get unlimited contacts
WORK HISTORY
Staff Platform Engineer @bp
London, GB
Led data governance team at bp, wrote REST APIs to ingest and manage technical and business metadata into the data catalog (Purview)2. Designed collection model, metamodel, and Taxonomy of master data and wrote REST APIs to access that for bp3. Built REST APIs for creating and managing data products for any source system4. Evaluated, Designed and led implementation of Databricks unity catalog for all Databricks instances at bp5. Built cost and monitoring automations, dashboards and alerting for everything running in Databricks6. Built a system that collects spark execution level information, analyses it and gives recommendation for performance improvement
EDUCATION
International Institute of Information Technology Bangalore
Post Graduate Diploma in Machine Learning & AI, Machine Learning
Scaler
Backend Development, Computer Software Engineering
Rajiv Gandhi Prodyogiki Vishwavidyalaya
Engineer’s Degree, Computer Science
SKILLS
ABOUT HITESH CHOUHAN
I am currently pioneering as a Staff Platform Engineer at bp, where my core competencies include leading-edge data governance, designing metadata management systems, and building advanced data analytics platforms. My mission is to foster a culture of data-driven decision-making, leveraging my expertise in Azure technologies and cloud solutions to align with BP\'s innovative and dynamic ecosystem. My goal is to contribute a diverse perspective and collaborative spirit to our team\'s endeavours.At BP, my role involves spearheading the development of REST APIs(FAST API) for data cataloguing and product management, as well as implementing Databricks Unity catalog across our instances. My recent achievements include automating cost monitoring and establishing a performance recommendation system for Spark execution. These initiatives, powered by Scala, Python, and Spark, are instrumental in bp\'s strategic objective to optimise data utilisation and operational efficiency.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.