Vivek Bhansali

About Vivek Bhansali

I like designing and developing Data Platforms of varied complexity!

Experience

1. Senior Data Engineer

   Omada Health

   Feb 2019 — Present

   Authored Medium Blog Post - Omada and Apache Airflow - Blog post gives a high-level overview of how the data engineers at Omada have integrated Airflow as a core tool for creating and managing various Data and Machine Learning pipelines, triggering report generation, and various data extracts from third-party applications. Few projects involved in - Building new ETL extracts and transforms using Apache Airflow to support jobs aggregating and loading data into Redshift- Contributed to containerization of Apache Airflow using Docker and deploying to Hashicorp’s Nomad (workload orchestration management)- Worked on designing a Reporting application responsible for generating various reports and delivering generated reports to various internal and external stakeholders using Ruby on Rails- Responsible for developing CI/CD deploy process to deploy code to ETL using Gitlab’s CI/CD pipeline- Worked on Integrating ETL with Tableau server to refresh various data sources and to generate reports for external clients. Technology used: Apache Airflow, Python, Apche Kafka, Docker, Amazon Redshift, AWS SNS/SQS, PostgreSQL, Ruby on Rails, Tableau, Hashicorp Nomad, Jenkins, Gitlab, Terraform

Skills

• Microsoft Office
• Creativity
• Postgresql
• Apache Kafka
• Entrepreneurship
• Bash
• Api Development
• Hbase
• Linux
• Jenkins
• Fluentd
• Javascript
• Ansible
• Mirth
• Html
• Application Programming Interfaces
• Cascading Style Sheets (Css)
• C++
• Dacpac
• Mysql
• Git
• Databases
• Computer Science
• Flume
• Sql
• Hadoop
• Matlab
• Php
• Docker
• Problem Solving
• Hl7 Standards
• Elk
• Vagrant
• Java
• Apis
• Django
• Amazon Web Services (Aws)
• Elasticsearch
• Innovation
• Website Development