Get your Emails warmed up and ready to send
Build sender reputation and reach more inboxes with automated email warmup.
Warm up your emails
Starting at $49/month
João Victor da Silva Mendes
Data Engineer Ii @Sonepar
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer Ii @Sonepar
Campinas, BR
Utilization of manual parallelism in Data Factory pipelines to optimize the ingestion of millions of records by distributing data across multiple threads in the Integration Runtime.• Data modeling according to business rules to ensure consistency and efficiency in data delivery to the Data Warehouse in analytical applications.• Development of custom operators in Apache Airflow using object-oriented programming to (1) interact with system APIs and generate files in Azure FileShare, and (2) integrate data from these files for Business Intelligence reporting across departments (Finance, Logistics, Operations, Sales).• Development of a DAG for data extraction from the Green Offer API to provide analytical dashboards on sustainability metrics related to Sonepar\'s green product offerings.• Analysis of Execution Plans of queries to optimize the data ingestion and transformation process in dimension and fact tables to maximize the daily update performance for the organization\'s Data Warehouse and Data Marts.• Implementation of Slowly Changing Dimension Type 2 (SCD-Type 2) to store historical item costs in analytical billing reports for the Controllership team.• Quality testing of Excel data sheets using Pydantic before loading them into the corporate Data Lake.• Creation and maintenance of a data catalog for the Control Tower data project to store technical and business metadata on data assets available for consumption by the software engineering team.
EDUCATION
UNINTER Centro Universitário Internacional
Graduação Sanduíche
ABOUT JOÃO VICTOR DA SILVA MENDES
Microsoft certified Data Engineer with technical knowledge and solid professional experience in SQL (MySQL, SQL Server), Python, Azure Data Factory, Apache Airflow, Databricks and Airbyte.Qualified professional in the development and architecture of pipelines that ensure the availability and integrity of data with the highest possible quality for end users according to pre-established business rules. I have consolidated experience in the orchestration and optimization of ETL (Extract, Transform, Load) or ELT (Extract, Load, and Transform) processes, extracting, transforming and delivering data efficiently to business decision makers quickly and accurately.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.