Cliff Leung

About Cliff Leung

Extensive R&D experience in Data Lake architecture, DB2, database tooling, database…

Experience

1. Senior Staff Software Engineer

   Linkedin

   Sep 2019 — Present

   I initiated the Data Health Monitor project (DHM) in 9/2019, and drove the design and development activities. DHM is a low-latency, self-service, and continuous monitoring tool of all public datasets in the LinkedIn\'s Hadoop Big Data ecosystem. DHM (1) gathers various data health vital signs (e.g, arrival time, schema and size) automatically at scale, and (2) performs data health diagnosis (such as late arrival). It allows users to subscribe to interested datasets to receive actionable alerts for data health issues such as availability, dataset size, and schema changes. The DHM service became generally available in 8/2021. https://engineering.linkedin.com/blog/2022/towards-data-quality-management-at-linkedin I jumpstarted the SuperTable project and led the design of the first SuperTable for the Jobs dimension, which combines elements from >50 sources across all LinkedIn. The Jobs SuperTable (as a \"data product\") precomputes everything needed for all job analytics with strong governance principles, high performance and strict SLA. The Jobs SuperTable became generally available in 8/2021.

Education

• The University of Texas at Austin

  M.S., Computer Sciences

• UCLA

  Ph.D., Computer Science

• The Chinese University of Hong Kong

  B.S., Electronics, Computer Science

Skills

• Db2
• Relational Databases
• Database Design
• Databases
• Software Project Management
• Data Modeling
• Distributed Systems
• Linux
• Data Warehousing
• Eclipse
• Business Intelligence
• Product Management
• Performance Tuning
• Architecture
• Sql
• Websphere
• Ibm Db2
• Integration
• Unix
• Software Development
• Software Engineering
• Testing
• Enterprise Software