Arshadh Ariff

Engineering Manager @Blackstraw

Halifax, NS, CA

Datamart Engine: Headed a team of data engineers that designed and built an engine to generate data marts, based on the column level metadata. The engine primarily reads metadata, creates & loads tables and performs slowly changing dimension changes over incremental feed. The system was built in Snowflake with SQL procedures, orchestrated using snowflake Tasks. This dynamic metadata driven system reduced TCO by 3X and improved the performance by 5X that drove near self-service experience for business users.Recommender System: Led the data engineering team that designed & deployed a job recommender system to match hospital vacancies with travel nurse candidates availability. Leveraging debezium, apache kafka, spark transformations, ML model online inference, deployed in Azure Kubernetes and recommendations stored in Snowflake for API consumption. The automated system reduced candidate filtering and response time under six minutes on average. BlogDocument Intelligence Platform: As an architect, designed and built a scalable document Intelligent platform which is a ML driven back end in the cloud. Implemented this solution using Kafka topics as service bus, multi-tenancy at topic, ML model and database levels; Used MongoDB as config and data store; Built a reporting layer to extract and report model accuracy and performance metrics.Data Platform Modernization: Redesigned a legacy demand forecasting platform running on Greenplum, with a Java application, Apache Spark and Livy server for computation. Migrated the forecasting data prep from R to Spark, reducing dependency on legacy tooling. The modernized system delivered cost savings on licensing and the flexibility to scale across varying workload types.

Mohamed Sathak Engineering College, Kilakarai

Bachelor of Engineering (B.E.)