Sandhya K

Experience

1. Data Engineer

   Freedom Mortgage

   Oct 2022 — Present · NJ, US

   Architected and implemented end-to-end data pipelines using Azure Data Factory, extracting data from diverse sources and loading into Snowflake for analytics.• Designed and optimized data processing workflows in Azure Databricks, leveraging Spark for large-scale transformations.• Built and maintained scalable Snowflake schemas, tables, and views to support complex analytics queries and reporting requirements.• Implemented data management strategies using Azure Data Lake Storage and Blob Storage, focusing on efficient partitioning, compression, and security.• Integrated Azure services (Data Factory, Logic Apps, Functions) to create robust, event-driven data workflows.• Developed Scala applications and Spark jobs for processing financial market data, supporting investment research and decision-making.• Implemented IoT streaming solutions with Databricks Delta tables and Delta Lake, enabling ACID transaction logging.• Created user-friendly data modeling environments using Databricks Notebooks, empowering data consumers with self-service capabilities.• Optimized query performance through custom monitoring solutions using Azure Monitor and Snowflake Query Performance Monitoring.• Integrated Snowflake with Power BI and Azure Analysis Services for interactive dashboards and reports.• Collaborated with cross-functional teams to deliver scalable, reliable data solutions in an agile environment.

Education

• University of Memphis

  Master's degree, Information Technology