Iacopo Alessandro Pedde
Data Engineer @Exponential Science
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Exponential Science
Design and develop ETL pipelines in Databricks using Python as the primary language, along with Pandas and PySpark, to handle ingestion, transformation, and metric generation.– Implement the Medallion architecture (bronze, silver, gold) to organize and optimize data workflows, ensuring reliability, traceability, and ease of access across the platform.– Create and optimize Delta tables with partitioning, schema evolution, and tuning techniques to support high-performance querying and reporting.– Build and maintain GitHub CI/CD pipelines, automating deployment, testing, and version control to streamline delivery and improve workflow consistency.– Use SQL alongside Python for data modeling, ETL transformations, and validation, ensuring accuracy and performance in downstream analytics.– Integrate external data sources through web scraping and APIs, enhancing coverage, timeliness, and overall data completeness.– Collaborate with blockchain researchers to translate project concepts into reliable, production-grade metrics and datasets.– Monitor and troubleshoot pipeline performance, applying debugging and optimization strategies to improve stability and efficiency.– Support data governance efforts by ensuring datasets are well-documented, consistent, and aligned with internal quality standards.
EDUCATION
Itcg Giovanni Spagna Spoleto
High School Diploma
Generation UK & Ireland
Data engineering
ABOUT IACOPO ALESSANDRO PEDDE
I\'m a Data Engineer, working within a multinational and well known association of…
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.