Chaitanya B

Sr Python Developer @AmFamRe

Madison, WI, US

Created data partitions on large data sets in S3 and DDL on partitioned data.• Converted all Hadoop jobs to run in EMR by configuring the cluster according to the data size.• Extensively used Stash Git-Bucket for Code Control• Monitor and Troubleshoot Hadoop jobs using Yarn Resource Manager and EMR job logs using Genie and kibana.• Consumed the data from Kafka using Apache spark.• Worked with SQOOP jobs to import the data from RDBMS and used various optimization techniques to optimize Hive, Pig and SQOOP.• Developed analytical component using Scala and KAFKA.• Designed Forms, Modules, Views and Templates using Django and Python.• Involved in application development for Cloud platforms using technologies like Java/J2EE, Spring Boot, Spring Cloud, Micro Services, and REST.• Implemented RESTful Web-services for sending and receiving the data between multiple systems.• Rewrite existing Python/Flask module to deliver certain format of data.• Developed an application in Linux environment and dealt with all its commands.• Administrate Continuous Integration services (Jenkins, Nexus Artifactory and Repository).• Designed and Developed DB2 SQL Procedures and UNIX Shell Scripts for Data Import/Export and Conversions.• Hands on experience Installation, configuration, maintenance, monitoring, performance and tuning, and troubleshooting Hadoop clusters in different environments such as Development Cluster, Test Cluster and Production.• Performed dynamic UI designing with HTML5, CSS3, less, Bootstrap JS, JavaScript, JQuery, JSON and AJAX.• Loading, analyzing and extracting data to and from Elastic Search with Python.• DB2 SQL Procedures and UNIX Shell Scripts were designed and developed for Data Import/Export and Conversions.• Experience in creating Kafka producer and Kafka consumer for Spark streaming.• Developed an information pipeline utilizing Kafka and Storm to store data into HDFS.

Teegala Krishna Reddy Engineering College

Bachelor's degree