Find Unlimited Emails.For Free.
Discover prospects, find their business emails, and build your pipeline with Unifers.
Start for FreeClaudio Mercante
Senior Data Engineer Azure Gcp Databricks @Avenue Code
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer Azure Gcp Databricks @Avenue Code
San Francisco, CA, US
Designed and delivered end-to-end Delta Lakehouse pipelines (Bronze → Silver → Gold) on Azure and GCP, processing structured, semi-structured (JSON, Parquet) and unstructured data (MongoDB) at scale using PySpark and Databricks.Implemented enterprise data governance frameworks using Unity Catalog — automating metadata management, lineage tracking, and sensitive data classification across analytics and reporting layers.Architected secure API-based ingestion pipelines (OAuth 2.0, API Keys) consuming internal and external WebAPIs, integrated with CI/CD workflows via DevOps.Applied advanced data modelling patterns (Data Vault, Dimensional Modelling, SCDs) to design flexible, resilient data ecosystems built for long-term scalability.Orchestrated complex multi-step workflows using Airflow and Azure Data Factory, reducing manual intervention in production deployments.
EDUCATION
FIAP
Graduation, Information Technology
IBTA - Instituto Brasileiro de Tecnologia Avançada
Post-Graduation, Project Management - PMI
SKILLS
ABOUT CLAUDIO MERCANTE
I turn messy, siloed data into reliable pipelines that businesses can actually make decisions with.With 20+ years in data, I\'ve worked across the full stack — from raw ingestion to curated, analytics-ready layers. My sweet spot is designing and building data lakehouses (Bronze → Silver → Gold) that scale without becoming a maintenance nightmare.I don\'t just build pipelines. I understand why they exist — and I make sure the data that comes out the other end means something to the business.What I work with: GCP|Azure|AWS · Databricks · dbt · Apache Airflow · Snowflake · Apache NiFi What I bring beyond the tech: I bridge the gap between engineering and business stakeholders — translating technical constraints into language that drives decisions, not confusion.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.