Islom Abdurakhmonov

About Islom Abdurakhmonov

Data Engineer with 8 years of progressive experience designing, building, and optimizing…

Experience

1. Senior Data Engineer

   Compass Funding Solutions, Llc

   Sep 2020 — Present · Clarendon Hills, IL, US

   Used Azure Data Factory (ADF) pipelines, linked servers, and datasets to copy data from on-premises SQL Server and Oracle SQL to Azure SQL Data warehouse (Synapse Analytics) using auto resolve and self-hosted Azure Integration Runtime.• Used Databricks PySpark, SparkSQL for complex transformation of semi-structured and structured data from multiple sources into Delta Lake• Used Databricks Data Lakehouse architecture: ingested data from different sources into ADLS Lakehouse, transformed and loaded files from Raw to Bronze, Bronze to Silver and Silver to Gold layers using PySpark and SparkSQL, performed complex aggregation.• Developed ETL & ELT pipelines using Databricks PySpark, SparkSQL to load & transform semi-structured and structured data from multiple sources into Delta Lake.• Developed pipelines using Azure Synapse Studio (sparkpool & SQLpool), Azure Data Factory and Azure Databricks (PySpark & SparkSQL) involving several Azure components including Azure Data Lake Storage Gen 2, Function App, Azure SQL DB, and Azure Synapse DW.• Leading the design and development of Enterprise Data Lakehouse using Medallion architecture in Databricks, Azure ADLS and Synapse.• Developed ELT pipelines using Azure Databricks (PySpark, SparkSQL and Scala) to load & transform semi structured and structured data from multiple sources into Delta Lake using Databricks Workflows.• Migrated on premises Data Warehouse and ETL solutions in SQL Server and SSIS to Azure Cloud (Databricks, Synapse, ADF, ADLS).• Used Azure Data Factory to ingest raw data from SaaS APIs, on-prem databases, and streaming sources. Implemented transformations in Databricks notebooks, leveraging incremental processing and schema evolution. Enabled self-service ingestion patterns for new sources via parameterized templates. Reduced time-to-delivery of new data sources by 50% through reusable pipeline frameworks.

Education

• The University of World Economy and Diplomacy

  Bachelor's degree

  2007 — 2011