Rambabu Pati

Big Data Engineer @AbbVie

Experience in deploying and managing the multi-node Hadoop clusters with different Hadoop components using Hortonworks and Cloudera. • Strong Experience on Horton works and Cloudera Hadoop distributions • Strong knowledge on HDFS architecture and Map-Reduce framework, Hive, Impala, Sentry, HBase, Sqoop, Spark. Kafka. • Experience in improving the Hadoop cluster performance by considering the OS kernel, Storage, Networking, Hadoop HDFS and Map-Reduce by setting appropriate configuration parameters. • Experience in administering the Linux systems to deploy Hadoop cluster and monitoring the cluster using Ambari and Cloudera manager. • Experience in upgrading Hadoop cluster from current version to minor version upgrade as well as to major versions (Hortonworks and Cloudera). • Experience in using Zookeeper for coordinating the distributed applications. • Experience in managing infrastructure like commissioning, decommissioning nodes, log rotation, rack topology implementation. • Experience in managing cluster resources by implementing fair and capacity scheduler. • Experience in scheduling jobs using OOZIE workflow. • Scheduling jobs using crontab. • Performing backup and disaster recovery of Name Node metadata and important sensitive data residing on cluster. • Strong knowledge in configuring High availability of Hadoop clusters. • Experience in configuring Hadoop Security (Authentication, Authorization, Encryption). • Experience in handling multiple relational databases: MySQL, SQL Server. • Upgraded the Hadoop Clusters from CDH 5.14 to CDP 7.1.2. • Created EMR Clusters and tested Hive and Spark applications in EMR 6.2. • Assisted Developers with problem resolution.