Sai Kiran M.
Fabric Data Engineer @Pathlines
Signup · Get unlimited contacts
WORK HISTORY
Fabric Data Engineer @Pathlines
Milton Keynes, GB
Migrated the Data from On premise data sources to Azure Medallion architecture using ADF, Azure Data bricks, Synapse SQL analytics and build the analytical dashboards using Power BI. Designed and developed end-to-end data Lakehouse solutions using Microsoft Fabric (OneLake, Lakehouse, Data Warehouse, Pipelines, and Notebooks). Built data ingestion pipelines using Data Factory (Fabric Pipelines) and Dataflows Gen2 to extract data from SQL Server, REST APIs, Azure Data Lake, and on-premises sources. Performed data transformation and modeling using PySpark notebooks in Fabric and T-SQL scripts in Fabric Data Warehouse/Lakehouse. Implemented medallion architecture (Bronze, Silver, Gold) in Fabric Lakehouse for scalable and maintainable data engineering solutions. Developed and optimized Power BI semantic models on top of Lakehouse/Warehouse for unified analytics reporting. Implemented data governance and security using Fabric Workspace roles, OneLake security, data permissions, and integration with Azure AD/Entra ID. Configured and managed Git integration in Fabric for CI/CD, version control, and deployment across Dev/Test/Prod environments. Improved pipeline reliability and performance using data partitioning, indexing, Delta Lake optimizations, and job monitoring.
EDUCATION
University of Hertfordshire
Master of Business Administration, Data Analytics
ABOUT SAI KIRAN M.
Professional Summary:•10+ years of Experience in developing, implementing, and refining data engineering solutions for huge volumes of data.•Specialized in Data Migration Projects from On premise to Cloud & Building Data & Analytics platform from the scratch in cloud•Built the data engineering platform (Cleansing, Validating & enriching) to support the downstream system’s use cases.Experienced in implementing end-to-end analytics solutions using Microsoft Fabric, leveraging Data Factory, Synapse Data Engineering, and Power BI experiences within a unified platform for seamless data integration and governance.•Handled data integration solutions and is responsible for the design and architecture to integrate necessary data components with various target systems.•Extensively handled On Premise servers to cloud data migration projects & built enterprise Data & analytics platform in Azure & AWS cloud•Extensively worked on Medallion architecture or Multi Hop Architecture or Bronze, Silver, Gold layer architecture•Extensively worked on Canonical data models, medallion Lakehouse architecture•Extracted the data from Dynamics CRM, Financial system (Dynamics F&O)to Azure Cloud (Azure Data lake) using ADF•Experienced data architect working with D365 data lake & Financial (F&O) reporting solutions•D365 R2R – revenue, cost of sales & margin reporting•Hands on experience on Lake house & Data Mesh Architecture•Spearheaded the development of a data warehouse to support business intelligence and analytics initiatives, resulting in an 85% increase in productivity•Managed a team of 4+ developers responsible for building ETL processes, data integration, and reporting tools•Strong hands-on knowledge of Azure data services like Azure Data Factory, Azure Data bricks, Azure Synapse Analytics, Azure Data lake (ADLS gen2), Azure SQL, Logic apps, Function apps, Azure Purview, Azure Active Directory, Azure log analytics, Azure Key Vaults, Azure Identity Management, Azure Event Hubs, Azure Repos, Azure Pipelines, Power BI
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.