Leonardo Pedroso dos Santos
Principal Data Engineer @Mondra
Signup · Get unlimited contacts
WORK HISTORY
Principal Data Engineer @Mondra
London, GB
Data Engineering & Performance Optimization: Desgin, development, and deployment of Databricks job ETL/ELTL pipelines for structured and unstructured data ingestion and daily processing. Development of Azure Data Factory pipelines for seamless integration with external API endpoints. Focus on spark (Pyspark / Spark SQL) optimizations and code refactoring in order to reduce TCO. Application of coding best practices like modularization, test-first, automated testing for data quality control and validation. Development of distributed structure using Dask for pure Python workloads. Data modelling and performance optimization for hierarchical data using GraphFrames framework.Data Science & Machine Learning/AI: model inferencing optimizations with Spark + ML Flow/OPs for reducing TCOs, model serving, registration and artifacts management. Fine tuning and deployment of LLMs models (BERT) to tackle Classification, NLP, and Clustering problems. Application of Generative AI models for generation of hierarchical data.Platform Engineering: Set up isolated workspaces infrastructure and CI/CD pipelines using Azure DevOps and Terraform. Automation of artifacts deployment using Power Shell script.Architecture & Solution Design: Migration from data warehouse-like architecture to delta lakehouse. Solution design for data processing platform features ensuring test centred design in order to balance business requirements and ensure software / component quality and performance needs. Set up technical improvement road map for constant platform evolution and robustness.Leadership: Principal engineer for data engineering and data science teams - growth team strategically, set up career plans and paths and technical growth- Main Skills / Tech Stack: Spark, Databricks, Azure Data Factory, Python, Pandas, PolaRs, Numpy, Dask, Pytorch, CI/CD, Terraform, Power Shell, PyTest, Chispa, GraphFrames, Performance Optimization.
EDUCATION
Universidade Presbiteriana Mackenzie
B.Sc in Computer Science, Computer Science
University of Oxford
Undergraduate Advanced Diploma in IT Systems Analysis and Design, Computer Science / Information Systems
USP - Universidade de São Paulo
Master of Business Administration (MBA), Computer Software Engineering
SKILLS
ABOUT LEONARDO PEDROSO DOS SANTOS
Hey :) I\'m LeoMy speciality is mainly in designing and development of big data platforms centred in performance optimisation and scalability, ensuring the efficient processing of terabytes of data. With a delivery-focused approach, I bridge the gap between technical excellence and business impact, ensuring that data-driven insights translate into tangible value. Expertise in Data Engineering & Big Data Pipelines - Designing of performance optimized ETL/ELT workflows focusing on efficiency and scalability in batch and real-time streaming scenarios with terabytes of data- Architecting systems and data platform design focusing on modularity and scalability for long term robustness- Supporting business intelligence and machine learning initiatives through robust and scalable data pipelines and governance. Technical StackMicrosoft Azure | Databricks | Apache Spark | Azure Data Factory | Terraform | Pytorch | MLFlow | MLOps Leadership & MindsetI thrive in high-performance environments, bringing analytical precision and a simplicity-first mindset (My Mantra: Simple > Complex > Complicated). My leadership approach fosters collaboration across data, engineering, data science and business teams to ensure seamless delivery focus and measurable impact to the business.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.