Durga Nemani

About Durga Nemani

Exceptional experience in design and development of peta byte scale Big Data (Hadoop…

Experience

1. Principal Software Engineer

   Yahoo

   Jun 2017 — Present

   Architected a Data lake on AWS for Member services organization. This data lake was developed using serverless technologies including Amazon Athena, Glue and S3. Data is stored on S3 and Athena is used to process, aggregate and query the data. Developed multiple data pipelines with Amazon Athena to process data from numerous sources including CRM, Telephony, Billing, Identity and click stream data. Developed terraform code to manage all the AWS resources for the datalake including S3 buckets and policies, IAM roles and policies, Glue databases, Athena workgroups and Secrets. Published Member services subscription data on Yahoo hadoop grid to be consumed by multiple teams with in the company. Worked with the Grid admins to establish project space, headless user and multiple data pipelines for transferring data between AWS data lake and the grid. Developed a Kinesis Consumer application to process real time GDPR events from Identity and send them to downstream REST API end points for multiple Member Services applications. Analyzed the impact of monthly statements of benefits on Customer churn using Machine Learning techniques like correlation matrices.

Education

• Virginia Commonwealth University

  MS, Computer Science

• Acharya Nagarjuna University

  Bachelor of Technology, Electrical and Electronics Engineering

Skills

• Emr
• Netezza
• Data Warehousing
• Hadoop
• Etl
• Extract, Transform, Load (Etl)
• Amazon Web Services (Aws)
• Sql
• Data Warehouse Architecture
• Data Modeling
• Big Data
• Hive
• Pl/Sql
• Aws Redshift
• Big Data Analytics
• Sdlc
• Databases
• Requirements Analysis
• Aws Emr
• Vertica
• Teradata
• Aws Vpc
• Oracle
• Business Intelligence
• Agile Methodologies