Rishyanth Sai

Senior Azure Data Engineer @Kraft Heinz

Chicago, IL, US

Analyzed data from Azure data storages using Databricks and Spark cluster capabilities, extracting valuable insights from large datasets.• Developed and maintained end-to-end operations of ETL data pipeline and worked with large data sets in Azure Data Factory; increased data pipeline throughput by 2x.• Developed custom activities using Azure Functions, Azure Databricks, and PowerShell scripts to perform data transformations, data cleaning, and data validation.• By implementing query optimization and database indexing, I significantly enhanced the efficiency of data retrieval. This involved building a separate data structure to quickly locate specific data, thereby reducing disk I/O and boosting query performance.• Implemented a tiered data lake architecture using Azure Data Lake Gen2 (ADLS Gen2) to efficiently manage both batch and streaming data for scalable, high-performance analytics.• Executed robust ETL processes on replicated datasets, applying deduplication, null handling, and data validation rules to ensure data integrity and quality across the pipeline.• Set up near real-time monitoring alerts and automated issue remediation workflows with Azure Monitor; cut incident response time by 50%. • Worked with Azure Logic Apps administrators to monitor and troubleshoot issues related to process automation and data processing pipelines.• Implemented Azure Event Hub to enable real-time ingestion and streaming of high-volume data, supporting low-latency processing and scalable analytics pipelines.• Leveraged data modeling and ETL processes to ensure data accuracy, consistency, and compliance with healthcare standards such as HIPAA, supporting secure and reliable data pipelines.• Configured and deployed Azure Purview to enable comprehensive data governance through data cataloging, lineage tracking, and advanced data discovery capabilities.• Created a secure network on Azure using NSGs, load balancers, auto scaling, and Availability Zones to ensure 99.95%.

SRI SATYA SAI UNIVERSITY OF TECHNOLOGY & MEDICAL SCIENCES

Bachelor's degree, Computer Science

Lewis University

Master's degree, Project Management