Dave G.

Senior Data Engineer @Physicians Mutual

Miami, FL, US

Part of the Agile Team and work on weeks sprints, daily sprint Status, sprint demo preparation and stakeholder demo and signoff. Day to-day responsibility includes developing ETL Pipelines in and out of data warehouse; develop major regulatory and financial reports using advanced SQL queries in snowflake. Worked with Hadoop architecture and the daemons of Hadoop including Name-Node, Data Node, Job Tracker, Task Tracker, and Resource Manager. Implemented AWS Lambdas to drive real-time monitoring dashboards from system logs. Developed Business logic in semantic layer by creating views in AWS Redshift to provide transformation logic visibility. Conducted statistical analysis on insurance data using python and various tools. Build Docker Images to run airflow on local environment to test the Ingestion as well as ETL pipelines.