Gopi Nath

Azure Snowflake Data Engineer @Wells Fargo

San Francisco, CA, US

Successfully implemented end-to-end data pipelines using Azure Data Factory, demonstrating expertise in ETL processes.Designed and implemented data processing workflows using Azure Databricks, showcasing proficiency in leveraging Spark for large-scale data transformations.Integrated Spark streaming and Kafka for real-time data analysis, demonstrating the ability to handle and process data in real-time from pacemakers.Built scalable and optimized Snowflake schemas, tables, and views, highlighting expertise in supporting complex analytics queries and reporting requirements.Developed data ingestion pipelines using Azure Event Hubs and Azure Functions for real-time data streaming into Snowflake, particularly relevant for pacemaker data.Leveraged Azure Data Lake Storage for storing raw and processed data, implementing data partitioning and retention strategies.Utilized Azure Blob Storage efficiently, implementing compression and encryption techniques for optimized storage costs and data security.Integrated Azure Data Factory with Azure Logic Apps for orchestrating complex data workflows and event-triggered actions.Implemented data governance practices and quality checks using Azure Data Factory and Snowflake, ensuring data accuracy and consistency.Implemented data replication and synchronization strategies between Snowflake and other platforms using Azure Data Factory and Change Data Capture techniques.Developed and deployed Azure Functions for data preprocessing, enrichment, and validation within data pipelines.