Michael Hernandez
Software Engineer at BP
- Role
- Data Engineer, Customers & Products at bp
- Location
- Chicago, IL, US
- LinkedIn followers
- 500 followers
About Michael Hernandez
I have been a data engineer within bp for 5 years. I am currently working within AWS to create digital solutions to support bp\'s retail store data analytics. I use Python, PySpark, and SQL on a daily basis to solve problems for my stakeholders.I was previously a Digital Graduate within BP’s early careers program where I worked within Trading & Shipping and Customers & Products supporting IT initiatives.Please feel free to connect.
Experience
Data Engineer, Customers & Products
Aug 2020 — Present · Chicago, IL, US
Developed data pipelines in AWS using Lambda, Glue, Redshift, and DynamoDB for retail data- Created near-real time pipeline to process daily transactions - Created datasets for loyalty, sales, and inventory reports using Python, SQL, and PySpark - Optimized S3 storage to reduce read/write operations • Increased test coverage of data pipelines - Implemented reusable AWS-mock tests to improve coverage across repository - Integrated Bazel within development cycle - Reduced software development cycle• Delivered on business goals - Automated manual processes to improve dimension tables - Analyzed site data to improve monitoring capabilities - Enhanced largest datasets by adding metadata and simplifying ingestion patterns• Cross-collaborated with other data engineers and teams to update best practices - Led to new practices moving forward reducing stress on shared resources - Documented pipelines to improve maintainability and debugging efficiency - Guided new engineers on pipeline development and deployment• Updated existing pipelines - Resolved bug fixes and gaps in existing data as needed by business - Updated shared libraries with new read/write methods increasing performance - Upgraded pipeline configurations from central team communications to maintain silent running
Education
The University of Texas at Austin
Bachelor of Science in Electrical Engineering, Electrical and Computer Engineering
2016 — 2020
Mesquite High School
High School Diploma, General Studies
2012 — 2016
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.