Matheus Pavanetti
Senior Data Engineer @Acerta
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @Acerta
Kitchener, ON, CA
Responsible for building and managing real-time data pipelines that capture and transform data from various customer manufacturing plants into our platform. Using Microsoft Azure and Databricks, ensure that data is efficiently processed and delivered accurately to support business needs. This involves handling large data volumes, optimizing performance, and maintaining data quality to enable reliable analytics and insights for our automotive clients.
EDUCATION
Technician College of Taubaté
Certificate, Eletronics / Information Technology Technician
Universidade de Taubaté
Bachelor of Engineering - BE, Computer Engineering
ABOUT MATHEUS PAVANETTI
Experienced Senior Software Engineer with over 10 years in the industry and multiple certifications, specializing in data engineering, IoT, web and API development, and operational systems. Skilled in delivering scalable solutions across sectors such as manufacturing, hospitality, healthcare, marketing, and oil & gas.Technical Skills:Programming Languages: Proficient in Python, Scala, Java, PHP, JavaScript enabling the development of robust software and automation scripts.Cloud Platforms: Extensive experience with AWS (EMR, EC2, S3, RDS, Athena, Glue, Redshift), Microsoft Azure (Data Lake, Data Factory, Synapse, Databricks, Functions), and Google Cloud Platform (BigQuery, Data Proc, Pub/Sub) for building and managing scalable data solutions.Big Data Tools: Expertise in the Hadoop ecosystem (HDFS, MapReduce, Hive, Kafka, Sqoop) and Apache Spark for large-scale data processing, including deployments in various environments (containerized, on-premises, cloud).Data Integration and Workflow: Proficient in using tools like Talend, Pentaho, SSIS, Apache NiFi, and Apache Airflow to automate data workflows and integrate complex data systems.SQL and NoSQL Databases: Skilled in SQL databases (MySQL, Oracle, SQL Server, Hive, Redshift, Azure Synapse) and NoSQL databases (Redis, MongoDB, Elasticsearch, HBase), along with experience in columnar data storage formats such as Parquet, ORC, and Avro.Data Visualization: Hands-on experience with Tableau, Power BI, Qlik Sense, Apache Superset, and Kibana to create interactive and insightful data visualizations.Operating Systems and DevOps: Proficient with Linux (various distributions) and Windows servers, along with experience in DevOps tools like Git, GitLab, Jenkins, Docker, Kubernetes, Zabbix, and Grafana for version control, CI/CD, and monitoring.Agile Methodologies: Experienced in agile frameworks including Scrum, ITIL 4, and DevOps to enhance team collaboration and project delivery.Community Involvement:Active contributor to the tech community through YouTube tutorials and GitHub projects, sharing knowledge and supporting open-source initiatives.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.