Austin Dsouza

Data Engineer - Azure @SSE plc

Perth, GB

DATA MIGRATION - Getting WEATHER Data from API_Source/Oracle/PremiveraP6_ERP to SQL_Destination -Managed Microsoft Azure Databricks (DBr), Fabric (Admin & Configuration), Synapse,Visualizations using PowerBI [DAX](POWER_BI_ADMIN)Data Factory Pipelines - DataFlowsMethodologies - Kimball, Scrum Real TIme Analytics - using Log Analytics (Kusto SQL). CODING LANGUAGES - to get data from REST API sources into ADLS/ADF, leveraged a number of python modules - pandas, requests, Pyspark, PysparkMLLib, LongChain and openAI. Ingested Data into Hive Meta-store (parquet/delta); Unity Catalog & SQL_DB using Pyspark/ADF. DATA-BRICKS PLATFORM SUPPORT - Setting up/Installation of Databricks Environment over Azure CloudPOWER_BI -BI/ Dax /Power Query /Pivot Tables made use of to produce Tables & Visuals. Star Schema.SERVERS & SYSTEMS Integrated Data Systems such as Oracle & MS SQL Database (OLAP) & Primavera P6 & IBM Maximo (OLTP) into Azure SQL Server using ADFTriggers - Schedule based/Event Based Triggers for timely retrieval of Business Data in ADLSgen2.DEV_OPS- Assisted in Azure DevOps practices such as Pushing Azure Data Factory Pipeline Codes from Development Branch to Production or Default. Made use of GitHub, Azure Git & GitLab.Testing - Assisted in some Data Quality Test Cases (T-SQL) like Removing Nulls, Duplicates & Optimizing Query Response RatesRequirements Gathering/Refining/Stakeholder management.Customer Support - Presented Dashboards wherever necessary to the Stakeholders. Of course, Based on Feedbacks improved the Dashboards on PowerBI (DAX Expressions)

CodeAcademy

Certification, Web Development Course

The University of Sheffield

PostgraduateDiploma, InformationSystems

De Montfort University

MSc, BusinessIntelligenceSystems & DataMining [SAS Endorsement]