Anand Nair
Bi Architect, Data Lakehouse @GP Strategies Corporation
Signup · Get unlimited contacts
WORK HISTORY
Bi Architect, Data Lakehouse @GP Strategies Corporation
Successfully led the migration of an on-premises enterprise wide data warehouse (50 dims, 5 facts) to a modern lakehouse architecture on Databricks, ensuring a seamless transition while improving scalability, performance and reliability. • Designed, implemented, and maintained end-to-end data pipelines on Azure Databricks for batch and streaming data sources within a lakehouse architecture, ensuring data reliability and accuracy. • Leveraged Apache Spark, Databricks Delta Lake, and Structured Streaming to process, transform, and aggregate large volumes of data from Oracle fusion ERP, resulting in a 80% reduction in data processing time. • Designed Azure DevOps CI/CD pipelines via Databricks Repos and Azure Multistage YAML Pipelines. Additionally, developed custom scripts using Databricks Jobs API to enable source control and deploy multitask Databricks workflow configurations. • Implemented data quality checks and monitoring using Databricks\' built-in features and custom scripts, improving visibility for stakeholders and reducing troubleshooting time by 40%. • Optimized Spark jobs to improve query performance, implemented cluster sizing analysis, and set up custom reports to monitor key performance metrics including job and task run time, cluster configuration and DB runtimes and load analysis per cluster while adhering to the lakehouse principles of reliability and performance. • Developed financial models for estimating project budgets in corporate Business Intelligence initiatives, delivering precise cost projections aimed at optimizing Azure Databricks expenditures • Created a logical warehouse by setting up Synapse Serverless views on Delta Lake to facilitate efficient querying and reporting, enabling data consumers to extract valuable insights with minimal latency. • Implemented and optimized Power BI datasets using incremental refresh strategies and VPAX metrics in Power BI, ensuring optimized refresh and query response times for business users.
EDUCATION
University of Maryland - Robert H. Smith School of Business
Master of Business Administration (M.B.A.), Finance, Data Analytics
TKM College of Engineering
B-Tech, Mechanical Engineering
Chinmaya Vidyalaya
High School
SKILLS
ABOUT ANAND NAIR
A highly self-motivated and achievement-oriented professional, Anand is a BI enthusiast…
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.