Suvi V

Senior Data Engineer @Change Healthcare

Nashville, TN, US

Migrate data from on-premises to AWS storage buckets.\\\\n• Developed a python script to transfer data from on-premises to AWS S3\\\\n• Developed a python script to hit REST APIs and extract data to AWS S3\\\\n• Worked on Ingesting data by going through cleansing and transformations and leveraging AWS Lambda, AWS Glue, and Step Functions\\\\n• Created YAML files for each data source and included glue table stack creation.\\\\n• Worked on a python script to extract data from Netezza databases and transfer it to AWS S3\\\\n• Developed Lambda functions and assigned IAM roles to run python scripts along with various triggers (SQS, Event Bridge, SNS)\\\\n• Designed and built scalable data pipelines to collect, store, and process large data sets from various sources, including social media, web logs, and IoT devices.\\\\n• Implemented and maintained ETL processes using Apache NiFi, Apache Beam, and Apache Spark, to extract, transform, and load data into data warehouses.\\\\n• Worked with AWS services such as S3, EC2, and Redshift, to store and analyze large data sets.\\\\n• Worked closely with data scientists and business stakeholders to provide them with the data they need for analysis and reporting.\\\\n• Mentored junior data engineers and provided technical guidance and support on data engineering projects.\\\\n \\\\n\\\\n \\\\n \\\\n\\\\n \\\\n