Nikhil S

About Nikhil S

Data Engineer with 7+ years of experience designing Azure-based data architectures and…

Experience

1. Data Engineer

   lululemon

   Mar 2022 — Present

   Solution Design: Drafted and operationalized an Azure cloud architecture blueprint, enabling flexible, robust, and portable data pipelines for real-time integration that reduced table load time by 15 minutes Built Scalable Data Warehouses: Developed robust scalable data warehouse solution on Snowflake using Azure cloud services (ADF, DevOps) by consolidating multiple data sources which optimized data retrieval time by 20 minutes Ownership of efficient Data Pipelines: Designed and developed end-to-end transaction validation automated ETL pipeline for 5TB to 10TB data using Python, PySpark, SQL, and ADF that decreased manual intervention by 50% Streamlined Deployment: Optimized SQL/Python scripts for batch data processing and deployed using Azure Dev-Ops CI/CD, accelerating the data ingestion process time by 20%, empowering the team to make data-driven decisions promptly Customer Focus: Utilized Databricks, PySpark, and Spark SQL to identify key trends, leading to a 10% increase in customer acquisition and a subsequent 15% boost in sales Power BI Data Refresh time Optimization: Remodeled Power BI data refresh via API, reducing refresh time by 15 minutes for seamless real-time data updates and enhanced reporting accuracy by 20% Troubleshoot Production Pipelines: Resolved production issues with avg 2 mins response time, identified root cause by analyzing systems logs and error messages, prevented prolonged downtime Cross-Functional Collaboration: Fostered a positive and productive working relationship between teams, leading to an increase in successful end-to-end project implementations