Sai Kumar

About Sai Kumar

Over 8+ years of extensive hands - on Big Data Capacity with the help of Hadoop Eco System across internal and also cloud- based platforms.• Expertise in Cloud Computing and Hadoop architecture and its various components - Hadoop File System HDFS, MapReduce, Spark, Name node, Data Node, Job Tracker, Task Tracker, Secondary Name Node.• Strong experience using HDFS, MapReduce, Hive, Spark, Sqoop, Oozie, and HBase.• Deep knowledge of troubleshooting and tuning Spark applications and Hive scripts to achieve optimal performance.• Experienced working with various Hadoop Distributions (Cloudera, Hortonworks, Map R, Amazon EMR) to fully implement and leverage new Hadoop features• Experience in developing Spark Applications using Spark RDD, Spark-SQL, and Data frame APIs.• Worked with real-time data processing and streaming techniques using Spark streaming and Kafka.• Experience in moving data into and out of the HDFS and Relational Database Systems (RDBMS) using Apache Sqoop.

Experience

1. Data Engineer

   Early Warning

   Dec 2020 — Present

   Involved in Migrating Objects using the custom ingestion framework from variety of sources such as Oracle, SAP/HANA, MongoDB, & Teradata.• Planning and design of data warehouse in STAR schema. Designing structure of tables and documenting it.• Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and extracted data from MYSQL into HDFS vice-versa using Sqoop.• Designed and implemented end to end big data platform on Teradata Appliance.• Performing ETL from multiple sources such as Kafka, NIFI, Teradata, DB2 using Hadoop spark.• Worked on Apache Spark Utilizing the Spark, SQL and Streaming components to support the intraday and real-time data processing.

Education

• Jawaharlal Nehru Technological University, Hyderabad

  Bachelor's degree, Computer Science