Denise Houle

About Denise Houle

J2EE/Java Spring 3-4 Struts ZK JSP EJB Servlets Tableau Quartz Scheduler, JAX-RS 2.0 Spnego, Velocity Templates BEA Weblogic JBoss ApacheTomCat C++ PowerBuilder Database: Oracle - 17 years DB2 – 2 years SQL Store Procedures Software versioning - SVN,CVS,PVCS

Experience

1. Senior Data Engineer

   General Motors

   Jul 2017 — Present · Warren, MI, US

   Environment: Hadoop Tools: Jupyter Notebooks, Hue, Spark 2.2-3.3, Python 3.9, Scala 2.11, Hive SQL Lead Data Engineer for One View of the Customer project. Responsible for data modeling and developing new data asset used by data scientists to create prediction models for when customers will take trips. Wrote hive sql/spark jobs to combine, transform and clean 1 year of raw telematic data into a Hadoop data asset usable by data scientists. Productionized data scientist python trip prediction model into a GM Hadoop/spark production job using best practices- error handling, logging, modularizing code for reuse. Performance tuned job that processed 20 million customers with nearly a billion trips. Transformed Hive SQL Vehicle Mileage production job into a pyspark application, reducing execution time from six to two hours Created comprehensive User Guide documenting OnStar/CX application eco-system, with diagrams showing data flow between 15 applications and multiple databases. Also how to analyze data quality issues. Led a team of contractors, working with the GM manager of the Loyalty team, as well as the UCM/CMDS teams to understand data quality issues, document them as use cases, and develop a process/methodology for analyzing and fixing issues. User guide is currently being used by a data steward team to fix quality issues with Loyalty data. Developed project plan for Teradata migration to Greenplum, identifying all tables used in Onstar Sandbox Heros projects and coordinated with Teradata migration teams to ensure no tables were missed and identify migration schedules. Led effort to create UAT Greepum migration plan. Lead developer for protype GM telematic data monetization effort. Created data lake of vehicle data using star schema. Wrote scala/spark code to transform raw telematic data into trips, translate lat/lng coordinates into state,city,county locations using geospatial polygons, added aggregated attributes like trip duration, avg speed etc.