Fazil Shaik

About Fazil Shaik

I specialize in designing, implementing, and optimizing data solutions using Microsoft Azure technologies. I have a proven track record in building scalable data pipelines, managing large datasets, and transforming data to drive business intelligence and actionable insights.Throughout my career, I have worked with cutting-edge Azure tools like Azure Data Factory, Azure Data bricks, Azure Data Lake, and Azure SQL Database, enabling businesses to efficiently store, manage, and analyze data in the cloud. My expertise spans across ETL processes, data integration and cloud data architecture, helping organizations streamline their data workflows and enhance decision-making capabilities.Key skills include:Designing and implementing end-to-end data pipelines and ETL workflowsData modeling, transformation, using Azure data factory, data bricks and Azure Data LakeImplementing cloud-based solutions to ensure high availability and performanceUtilizing SQL, Pyspark for data manipulation and automation tasksWorking closely with cross-functional teams to align data solutions with business goalsI am passionate about solving complex data challenges and continuously exploring new tools and techniques to improve data processes. My focus is always on delivering high-quality, efficient, and scalable data solutions that meet organizational needs.If you\'re looking for a data professional with a deep understanding of Azure cloud technologies and a commitment to driving data-driven success, feel free to connect with me!

Experience

1. Experienced Associate

   BDO USA

   May 2022 — Present · Bengaluru, IN

   Have involved in developing pipelines in ADF and view on existing Azure SQL tables to fetch the data from different sources and transform the data by using Azure Databricks, Pyspark and loaded the final transformed data into Azure synapse to generate reports in Power BIRESPONSIBILITIES:• Involved in gathering requirements from business analysts and analyzing requirements.• Developing ADB notebooks using Pyspark - SQL for transformation and aggregation of data from multiple sources.• Created Delta Lake Tables and loading files into Delta Lake tables using Pyspark notebooks.• Created Azure data Factory Pipelines to extract data from REST API source to azure cloud.• Written Pyspark code to transform and load data from staging to curated layer(foundation layer).• Provide the Data to the powerBI Reporting team as per the business requirements.• Implemented ADF pipelines for Data ingestion and Data processing.• Scheduled the pipelines using Triggers.• Attend the client calls to clarify the requirements related if any.• Implemented the Data in Delta Lake using Azure Data Factory.

Education

• Sri Sai Institute Of Technology And Science

  Bachelor of Technology

  2014 — 2018

• Sangeetha High School

  High School Diploma

  2012 — 2012

• Narayana Junior College

  High School Diploma, Mathematics

  2012 — 2014