Akshay Deep Goud Gundla

Azure Data Engineer @J.P. Morgan

US

Designed and implemented robust pipelines using Azure Data Factory. Developed Python, Spark and PySpark scripts to automate data ingestion, transformation, and loading processes, ensuring efficient and reliable data integration. • The project also combined sources of data including REST API, Azure SQL DB, and Data Lake. Additionally, we utilized cloud services like Azure Key Vault to ensure efficient management of data, ETL processes, and monitoring. This showcased our approach to handling and utilizing insurance analytics data.• Extracted, transformed, and loaded data using Azure SQL DB, Azure Data Factory, Spark SQL, PySpark and Azure Data Lake Storage.• Automated ELT workflows to extract raw data from SQL/NoSQL sources, load into staging layers, and transform into analytics-ready schemas using dbt and SQL.• Developed transformations and aggregation of data in Databricks using notebooks, Spark Data Frames, Spark SQL, and Python.• Participated in the analysis, design, and development phase of the Software Development Lifecycle (SDLC). Experience in the agile environment, used to have sprint planning meeting and retro meetings for every sprint.

Saint Louis University

Master's degree

Saint Louis University

Masters in Information systems