Divya T

Sr Data Engineer @AgFirst Farm Credit Bank

Columbia, SC, US

I have a strong background in data processing, having developed complex MapReduce and Streaming jobs in Scala for handling millions of records. I also proficiently used PySpark and Spark SQL to manage terabytes of data, ensuring efficient data extraction, loading, and querying.Data security is a top priority, and I implemented strict measures in Snowflake to achieve GDPR and HIPAA compliance. Additionally, I managed Hadoop ecosystems, overseeing data recovery and backup for over 100 TB of data.In AWS, I orchestrated ETL data flows handling 50 TB of data using various tools and led Informatica mapping development, improving data integration. These experiences, combined with my proficiency in managing extensive data volumes, designing data models, and optimizing data processing procedures, make me a valuable asset in data management and analytics.

JNTUH College of Engineering Hyderabad

Bachelor's degree, Computer Science and Engineering