Mohit Singhal

About Mohit Singhal

As an Azure Data Engineer at Infosys, I collaborate on projects involving data mining platforms, leveraging Azure Data Factory and PySpark to automate data extraction and transformation from unstructured and semi-structured formats into Power BI dashboards. My role involves orchestrating Azure Data Factory pipelines, utilizing triggers, and creating linked services for seamless data integration. Graduating with a B.Tech in Computer Science from the International Institute of Information Technology, Bhubaneswar, I bring a strong foundation in technology and programming. Proficient in naming conventions, query optimization, and defect triage, I am certified in TensorFlow for AI and machine learning, equipping me with valuable insights to support data-driven decision-making and innovative solutions.

Experience

1. Azure Data Engineer

   Infosys

   Aug 2021 — Present · Pune, IN

   Experience working on a Data Mining platform using Azure and Pyspark to automate the extraction of unstructured, semi-structured data from pdf, docx, and xlsx document formats into Power BI dashboards.• Orchestrate Azure Data Factory (ADF) pipelines with the suitable triggers (storage, tumbling, and scheduling) to run the ADF activities such as Databricks, Data Flow, Copy, For Each, Get Meta Data, Lookup, Stored Procedure, Logging, etc. to extract and transform the data from documents and websites.• Having experience in creating linked services such as ADLS Gen 2, Amazon S3 bucket, Blob Storage, Azure SQL DB, Excel, CSV, etc. on ADF to store the connection string before creating the dataset for ADF activities such as copy activity on both the source and sink sides, data flow activity, databricks connection, etc.• Strong experience working on Azure Databricks to write Python, Pyspark scripts, and Azure Cognitive Services such as Document Intelligence Layout API, custom, and neural models to enrich and transform the data.• Experience in creating notebook jobs in Azure Databricks notebooks to run the multiple-use case solution from a single notebook and pipeline in ADF.• Experience in creating logic apps to send notifications in case of pipeline failure and in data ingestion through ADF pipelines into ADLS or blob storage.• Strong experience in creating function apps on the Azure portal to scrape the data from the trading websites using the Selenium driver and custom Python and calling them through the ADF web function caller activity to run the CI/CD pipeline to execute the web scraper function.• Professional experience in migrating Azure Mess Architecture (MAPS) to Azure Data Hub (ADH) to make client data secure and private with more cost efficiency.• Expertise in creating multi-page Power BI dashboards and filters to visualize the results in various types of widgets, whether the source of data is SQL DB, Excel, etc.

Education

• International Institute of Information Technology, Bhubaneswar

  Bachelor of Technology, Computer Science

  2017 — 2021