Sree Kanth

Experience

1. Data Engineer

   Verizon

   Jun 2024 — Present · Irving, TX, US

   Migrated application data from Teradata to BigQuery using Airflow DAGs, ensuring seamless data integration and performance optimization.• Successfully transitioned data from Oracle to BigQuery through Airflow DAGs, leveraging efficient ETL processes.• Designed and executed complex SQL queries to transform and manipulate data for analytical insights.• Converted Teradata SQL scripts into BigQuery-compatible queries to maintain functionality and optimize performance.• Authored JSON configurations to create DAGs utilizing the Data Processing Framework (DPF).• Developed custom scheduling plugins adhering to the US Calendar for workdays DAG execution at user-defined times.• Created advanced scheduling plugins for DAGs to run on the nth workday, first three days and last two days of user-defined months, accounting for specific time zones.• Designed a scheduling feature for DAGs to execute on the second day of user-specified months with time and timezone flexibility.• Built a custom Cloud Function to test DAG functionalities, incorporating Jinja templates for dynamic task generation.• Engineered a feature to dynamically determine DAG start dates based on user requirements.• Developed Jinja templates integrated with JSON configurations to automate DAG creation for transferring files from GCS to AWS EC2 instances.• Established secure JDBC connections in Airflow DAGs using PEM and JKS files for enhanced data security.• Implemented functionality to strip headers and footers from source data files prior to loading into BigQuery.• Enhanced the DPF framework by enforcing task dependency, ensuring subsequent tasks execute only upon the successful completion of prior tasks.• Designed a feature file sensor to validate the presence of required files before initiating DAG execution.• Conducted a proof of concept (POC) to establish a Salesforce connection, successfully extracting table data and storing it in GCS.

Education

• Mahatma Gandhi Institute of Technology

  Bachelor of Engineering, Mechanical Engineering

  2013 — 2017

• Wilmington University

  Master's degree, Computer and Information Systems Security/Information Assurance