Manisha D

Experience

1. Sr Aws Data Engineer

   Verizon

   Aug 2021 — Present · Dallas, TX, US

   Designed and setup Enterprise Data Lake to provide support for various uses cases including Analytics, processing, storing, and Reporting of voluminous, rapidly changing data. Hands-on experience with Amazon EC2, Amazon S3, Amazon RDS, VPC, IAM, Amazon Elastic Load Balancing, Auto Scaling, CloudWatch, SNS, SES, SQS, Lambda, EMR and other services of the AWS family. Experience in Kafka cluster setup, configuration, and optimization for performance and reliability.Import the data from different sources like HDFS/HBase into Spark RDD and perform computations using PySpark to generate the output response. Used AWS EMR to transform and move large amounts of data into and out of other AWS data stores and databases, such as Amazon Simple Storage Service (Amazon S3) and Amazon Dynamo DB. used HP quality centre (qc)/ALM and selenium for releases, requirements,tests,execution and tackling defects• Responsible for maintaining quality reference data in source by performing operations such as cleaning, transformation and ensuring Integrity in a relational environment by working closely with the stakeholders & solution architect. • Designed and implemented data pipelines for data processing using Perl and GCS. Monitered Kafka clusters using tools like Prometheus, Grafana, or Confluent Control Center.Kept abreast of industry trends and emerging technologies in data engineering and QE SDE.• Designed and developed Security Framework to provide fine grained access to objects in AWS S3 using AWS Lambda, Dynamo DB.Integrated Quality Engineering practices into the data development lifecycle, ensuring data quality and reliability throughout the process.Collaborated with QE teams to implement automated testing strategies for data pipelines, reducing errors and enhancing data accuracy.Proven expertise in Quality Engineering Software Development (QE SDE) to ensure data accuracy, reliability, and performance.