Sushma T

Data Engineer @American Express

Importing the Data using Sqoop from various source systems like Mainframes, Oracle, MySQL, DB2 etc, to Atlas Data Lake Raw Zone. Developed ETL pipelines in and out of Data Warehouse using combination of Python and Snowflakes Snow SQL Writing SQL queries against Snowflake. Worked on creating Internal and External Tables using HIVEQL by Partitioning and Bucketing where SAS users can perform their Big Data Analytics. Worked on using Kafka, Spark streaming, to process the streaming data in specific use cases. Worked on creating Internal and External Tables using HIVEQL by Partitioning and Bucketing where SAS users can perform their Big Data Analytics. Performed Continuous release management in Microsoft DevOps.