Rishabh Tiwari

About Rishabh Tiwari

Highly skilled Senior Data Engineer with over 7 years of experience across the Pharmaceutical, FinTech, Digital, and Insurance domains. Proven expertise in architecting and optimizing large-scale enterprise data platforms using cutting-edge technologies on Azure and AWS. Passionate about solving complex data challenges, leveraging tools like Databricks, Spark, SQL, and Hadoop to drive data-driven decision-making.Adept at developing end-to-end data pipelines, optimizing performance, and ensuring high-quality data ingestion and processing. My hands-on experience with a variety of cloud platforms and big data tools enables me to deliver robust, scalable solutions tailored to meet business needs. I thrive in dynamic environments where I can continuously explore new technologies and collaborate with teams to drive innovation.

Experience

1. Senior Data Engineer

   MetLife

   Dec 2022 — Present · Noida, IN

   At MetLife, I have been instrumental in driving data engineering initiatives that enhance the performance and reliability of our data infrastructure. Key contributions include:• : Led the design and deployment of cloud data platforms for large-scale data ingestion from legacy systems, improving data availability and operational reliability across the organization.• : Streamlined batch processing jobs on the Azure Data Factory, achieving a 40% improvement in execution speed, which significantly boosted overall efficiency.• : Developed and implemented event-driven data pipelines using Azure Event Hubs and Stream Analytics, enabling real-time data processing and enhancing our ability to handle dynamic data flows.• : Designed and created a Power BI dashboard that aggregates logs from diagnostic setting rules across multiple Azure Data Factory instances. This dashboard unifies performance monitoring by generating reports that track the performance of pipelines across different resource groups, providing critical insights that help in proactive troubleshooting and optimization of data workflows.• : Led the evaluation of Microsoft Fabric platform, identifying key opportunities to leverage its features for business use cases, positioning the team to take advantage of emerging technologies,

Education

• St. Francis Institute Of Technology

  Bachelor of Engineering (B.E.), Computer Engineering

  2012 — 2016

• TrendyTech

  Big Data Masters Program, Big Data Analytics

• Purdue University

  Post Graduate Program in Data Engineering by Simplilearn, Data Engineering