Sahithi Maddipati

Data Engineer @Fox Corporation

US

Developed automated pipelines using Apache Airflow to connect to API endpoints, process DSAR (Data Subject Access Request) requests for access, deletion, and correction, interfacing with Redshift, Snowflake, and various cloud databases.• Connected to Redshift, Snowflake, and various cloud databases to wipe or access data, and updated the API post-processing, handling any issues efficiently.• Managed data migration from Redshift to S3 and from S3 to Snowflake, ensuring seamless data transfer and integrity.• Participated in ad-hoc advertising data analysis, aggregating data from Redshift and DynamoDB, moving it to Snowflake, and building tables and stored procedures to facilitate quarterly data analysis for analysts.• Built robust data pipelines using Apache Airflow, S3, and Snowflake, optimizing data flow and processing efficiency.• Managed to create the scheduled jobs to clear out the tables that are more than month old to resolve the bloating issue with the current pipelines dumping in the envelopes in DynamoDB.