Siarhei Staradubets
Lead Data Engineer (Client Axpo Group) @EPAM Systems
Signup · Get unlimited contacts
WORK HISTORY
Lead Data Engineer (Client Axpo Group) @EPAM Systems
Leipzig, DE
Role: Data Software Engineer, Engineering Team LeadResponsibilities- As a data engineer, implemented data flow between several external systems and a centralized data lake using Apache Spark on Azure Databricks, Azure Data Factory, and Azure Functions- Managed medallion architecture data lake and data lakehouse for high-variety data, implemented on Databricks, Delta, Azure Synapse Analytics, Azure Storage and Azure SQL Server- Design and implementation of Data Quality Gates to support technical and business quality checks- Design and implementation of different data lake access layers, including self-services and apis- Support of data governance processes, production support, work on critical issues, migrations and optimizations- Worked directly with the customer-side resources. Designed and implemented their data models, provided data insights, managed SCRUM tasks in Jira, helping to organize inter-team communication;Technologies and services- Cloud: Microsoft Azure- Programming languages: Scala, SQL, Java, Python- Services: Databricks, Azure Functions, Azure Data Factory, Azure Synapse, Azure Storage- Data formats: Parquet, Avro, Delta, CSV, JSON.
EDUCATION
Belarusian State University of Informatics and Radioelectronics
Master's degree, Instrument making, metrological support of information-measuring devices and systems
Belarusian State University of Informatics and Radioelectronics
Bachelor's degree, Metrological support of information systems and networks
SKILLS
ABOUT SIARHEI STARADUBETS
As a Lead Data Engineer, I leverage my strong technical background and over 13 years of software development experience to deliver reliable, fault-tolerant, and scalable data solutions for various projects and business domains. I began my professional journey as a Java Software Engineer, honing my skills in backend development while collaborating on diverse services and technologies. Motivated by a passion for data, I successfully transitioned into the role of a Data Engineer. The main toolset includes Azure, Databricks, Apache Spark, Java/Scala/Python, SQL.My expertise spans various business domains, including travel, booking systems, energy, and retail. I have successfully developed and deployed data ingestion and ETL pipelines, Spark batching and streaming applications, data lakes, and data lakehouses, medallion architecture, serverless and microservices architectures, as well as data visualization and dashboarding tools using Azure, Databricks, and Spark. Furthermore, I have also worked with AWS. I enjoy collaborating with diverse and talented teams, and I am always eager to learn new technologies and best practices in data engineering.I adhere to clean code principles and advocate for code quality and data quality in my work.I hold multiple certifications in Azure, Databricks, and Apache Spark.• Azure Certified Data Engineer;• Azure Administrator Associate;• Databricks Certified Data Engineer Professional;• Databricks Certified Associate Developer for Apache Spark.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.