Lucas Nogueira da Costa
Data Engineer @BASF
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @BASF
Berlin, DE
Driving backend development and data platform modernization on a global scale, working closely with stakeholders across regions including the U.S, China, Malaysia, and South America. Leading the migration of over 200 complex tables from Azure Synapse to Databricks, resulting in a 20% reduction in infrastructure costs and 40% faster data availability.Key focus areas include integrating new data sources, automating business processes, and orchestrating big data pipelines using Databricks (Spark, PySpark), Azure Data Factory, and SQL. Implemented Medallion Architecture, Delta Live Tables, Unity Catalog, and Row-Level Security. Designed semantic models with Genie and supported AI-driven use cases by developing metadata layers and business logic documentation.Delivering scalable, business-aligned data solutions in agile environments, while enabling self-service analytics and improved governance across the organization.
EDUCATION
Oxford School
Exchange, Business English
Universidade São Judas Tadeu
Bachelor's degree, Computer Science
SKILLS
ABOUT LUCAS NOGUEIRA DA COSTA
Data professional with 10 years of experience in digital solutions, data engineering, and process optimization. I hold a Bachelor\'s degree in Computer Science and specialize in building scalable, cloud-based data platforms using tools such as Databricks, PySpark, Azure Data Factory, SQL Synapse, and Power BI.Throughout my career, I have led end-to-end data projects, integrating diverse data sources, developing robust ETL pipelines, and automating business processes to drive efficiency and value. My recent work includes the full migration of a global enterprise data warehouse to Databricks, resulting in significant cost savings, improved data availability, and the implementation of modern architectures such as the Medallion Framework, Delta Lake, and Unity Catalog.In addition, I’ve supported the development of AI-powered use cases by designing metadata strategies, semantic layers, and governance models to enable data discovery and business-driven analytics. Passionate about agile delivery, I collaborate closely with cross-functional and global teams to deliver impactful, sustainable data solutions.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.