Abhishek G

Data Platform Developer @ICICI Prudential AMC Ltd

Collaborated closely with internal and external stakeholders, subject matter experts, end users, and internal and external stakeholders to comprehensively understand project scope and requirements. Developed reusable ADF pipelines, Artifacts, ARM templates, Databricks notebooks incorporating various ETL & ELT transformations to streamline data processing and enhance reusability across projects. Created, provisioned different Databricks clusters needed for near real-time streaming, batch and continuous streaming data processing and installed the required libraries for the clusters. Utilized Event Hub, Azure Logic Apps for HTTP requests, email triggers, using databricks. Responsible for designing Azure DevOps, CI/CD process, ETL and ELT pipelines to meet business use cases by using Databricks, Python, PySpark, ADF data flows, Pipelines and Synapses, DataLake, and automate pipelines using various ADF triggers. Develop customized forms and workflows in PowerApps according to the user requirements. Create and maintain interactive and self-service Power BI, Tableau visuals and reports through data interpretation and analyses, integrating various reporting components from multiple data sources. Configured databricks clusters, ADF triggers, notifications, alerts, and reminders using Power Automate to keep stakeholders informed about important events, deadlines, and inventory updates. Implemented Security and Compliance Measures for data governance, storage, processing, and used Azure Key Vault to secure passcodes, and Azure Active Directory to implement Role Based Access Control. Worked with diverse data formats, volumes, including ACRO, XML, JSON, and Parquet ensuring compatibility. Create insightful Power BI reports using DAX, Power Query, Slice & Dice to monitor factors to financial and operational variances and anomalies helping the executives in key decision making.