Vishal Ingale

About Vishal Ingale

I have 5+ years of working experience. Currently working as Data Engineer with Deloitte USI. GCP Developer – Worked on batch and realtime data using SQL in BigQuery and Airflow. Adept in end-to-end application Strong hands-on experience in BigQuery, Airflow, SQL, Python, CICD pipeline Excellent skills on working with BigQuery and Data Analysis. Worked to get the business requirements from Users & convert them into technical requirements. Excellent understanding of Bigquery architecture, table partitioning, clustering, best practices, type of tables, best practices etc. Worked on Exploring, Preparing data using BigQuery for further analysis & measuring KPI’s which helps in business growth. Experience of data manipulation, extensive data analysis, data migration and extracting useful insights from the data. Well versed with business process mapping, development and data mapping using query languages (SQL), Airflow. Good understanding of business flow between various upstream and downstream source systems Experience in Data Analysis, Release Management and Maintenance Good knowledge of working with SQL, Google Cloud Platform (GCP) Services -(Big query, Composer, Airflow), Advancedexcel, Talend basics, Tableau basics, Github, Python basicsCurrently working in Migration project Created ETL pipeline, best performing tables with partitioning/clustering etc enabled in BigQuery keeping best practices in mind. Written Complex SQL queries keeping execution cost in mind. Worked on stored procedure to load the data from raw zone to process zone. Worked on SCD1(Slowly Changing Dimension), SCD2 logic using SQL. Created, loaded and queried partitioned tables for daily time-series data. Worked on real time and batch data. Loaded data into table using orchestration tool, Airflow by scheduling DAG. Created DAG (Directed Acyclic Graph) for scheduling job to load the data into process zone table Closely worked with data modeler to meet the business needs. Worked on automation for creating DDL (SQL) from mapping specification (csv format) using python and its libraries to reduce efforts of developers. Developed expertise in automating workflow processes by working on dynamic Directed Acyclic Graph (DAG) generation, significantly reducing the need for manual DAG creation. Supported on parallel releases, Prod development, QA / UAT /Hypercare issue. Tested the processed data with various scenarios by manipulating source data.

Experience

1. Cloud Consultant

   Deloitte

   Jul 2024 — Present · Pune District, IN

Education

• Swami Ramanand Teerth Marathwada University

  Bachelor of Technology - BTech, Computer science and Engineering

• P. R. Pote (Patil) Education & Welfare Trust's Group of Institutions's College of Engineering & Management, Amravati.

  Diploma in computer Engineering, Computer Engineering