Saikrishna K

Senior Data Engineer @RBC

Toronto, ON, CA

Ensure cloud infrastructure security using Azure Security Center and Identity & Access Management (IAM) for threat detection and access control.•Manage the full project lifecycle including analysis, requirements gathering, development, testing, and documentation.•Design and develop scalable Azure Data Pipelines with automation triggers to streamline data refresh and integration processes.•Build and maintain robust data pipelines that handle complex and diverse enterprise data sources using Azure Data Factory.•Integrate data from sources such as Azure BLOB Storage, SQL Server, and Azure Data Lake, enabling seamless movement and transformation.•Develop comprehensive technical design specifications and interface documentation aligned with business requirements.•Promote data reuse and governance using tools like Azure Data Catalog, metadata management, and Azure Search.•Integrate Power BI with ADF and Azure Logic Apps to automate data orchestration and visualization workflows.•Leverage Power BI’s machine learning features for predictive analytics and data forecasting.•Monitor and optimize Power BI usage by analyzing report performance metrics and audit logs.•Process and manage structured and unstructured data formats including XML, CSV, Excel, ORC, and Parquet.•Design and maintain scalable storage solutions using SQL Server, Azure SQL, Azure Data Warehouse, and Azure Data Lake Store.•Configure robust error handling, logging frameworks, and email notifications in ADF Pipelines to improve reliability.•Develop real-time and batch processing solutions using a mix of ADF, SSIS, and streaming technologies for efficient data integration.