Satya Dodda

Azure Data Engineer @Philips

Philips, MA

Created Dynamic Pipelines, Data Sets, Linked servers in Azure Data Factory for data movement and data transformations. · Developed and designed an API in Python.· Implemented medium to large scale BI solutions on Azure using Azure Data Platform services (Azure Data Lake, Data Factory, Data Lake Analytics, Stream Analytics, Azure SQL DW, HDInsight/Databricks, NoSQL DB). · Development of Python API’s to dump the array structures in the processer at the failure point for debugging. · Migrated existing Teradata to Oracle load scripts from a non-ETL framework into Turner\'s approved ETL platform which is a combination of proprietary UNIX-based ETL wrappers which utilize Data Integrator as the preferred means of integration and transformation between databases.· Build the data pipelines in Alteryx for inputting the data in Tableau Dashboards.· Designed & implemented migration strategies for traditional systems on Azure (Lift and shift/Azure Migrate, other third-party tools. · Extracted data from different sources (text, Parquet, csv files, Azure and On-Premise Databases) to ADL, blob and used PySpark for transformation of data on Azure Databricks. · Worked on Spark Data frames, Temporary Tables for transformations. · Created Python notebooks on Azure Databricks for processing the datasets and load them into Azure SQL databases.· Used python for Data manipulation, Data pipelines and ETL prototyping and ETL prototyping in Snowflake and Task scheduling in Airflow. · Worked on executing these notebooks using Databricks Activity in Azure data factory. · Worked with notebook parameterization, execute notebooks and install different azure packages. · Worked on copy or moving files from container to another using Python SDK for Azure. · Created an Automated Databricks workflow notebook to run multiple data loads (Databricks notebooks) in parallel using Python.

Christian Brothers University

Master's Degree, Computer and Information Sciences, General

Sathyabama Institute of Science & Technology, Chennai

Bachelor of Science, Electrical, Electronics and Communications Engineering