Sai Varun Gadde

About Sai Varun Gadde

I design and build data platforms that actually get used the kind where analysts trust…

Experience

1. Data Engineer

   PNC

   Jan 2024 — Present · US

   Built and deployed Microsoft Copilot Agents using RAG, Azure OpenAI, and enterprise APIs, improving analyst productivity by 35%.• Created secure, task-specific Copilot agents with RBAC and Microsoft Teams integration for real-time insights via natural language.• Designed scalable analytics pipelines using Azure Synapse SQL & Spark pools over partitioned Delta Lake tables, reducing latency by 40%.• Automated complex ETL pipelines using ADF, Synapse Pipelines, and REST API integrations to support ingestion and transformation.• Developed CI/CD pipelines for ADF, Synapse, and Databricks using Azure DevOps and YAML, ensuring zero-downtime releases.• Built optimized Spark jobs in Azure Databricks using caching, broadcast joins, and window functions for large-scale batch data.• Implemented Spark Structured Streaming from Event Hubs into Delta Lake, reducing streaming data latency to <2 minutes.• Integrated Azure Key Vault, MLflow, and Synapse for secure data access, model tracking, and collaborative analytics workflows.• Created automated alerting and remediation workflows with Azure Logic Apps and Durable Functions, enhancing pipeline reliability.• Set up Git-based branching strategies in Azure DevOps Repos, improving traceability and collaboration across 6+ engineering teams.

Education

• University of North Texas

  Master's degree

• Vardhaman College of Engineering (VCEH)

  Bachelor of Technology - BTech