Sai Lokesh Bommisetti

About Sai Lokesh Bommisetti

Having 9 years of IT experience in a variety of industries working on Big Data technology using technologies such as Cloudera and Hortonworks distributions. Hadoop working environment includes Hadoop, Spark, MapReduce,Kafka, Hive, Ambari, Sqoop, HBase, and Impala An accomplished Hadoop/Spark developer experienced in ingestion, storage, querying, processing and analysis of big data Experienced with the BigData Frameworks - Kafka, Spark, HDFS, HBASE and Zookeeper. Extensive experience in working with various distributions of Hadoop like enterprise versions of Cloudera (CDH4/CDH5), Hortonworks and good knowledge on MAPR distribution. Experience in using D-Streams, Accumulator, Broadcast variables, RDD caching for Spark Streaming. Experienced in implementing scheduler using Oozie, Airflow, Crontab and Shell scripts Experience in integrating Hive queries into Spark environment using Spark SQL. Written multiple MapReduce Jobs using Java API, Pig and Hive for data extraction, transformation and aggregation from multiple file formats including Parquet, Avro, XML, JSON, CSV, ORCFILE and other compressed file formats Codecs like gZip, Snappy, Lzo. Designed ETL workflows on Tableau, Deployed data from various sources to HDFS. Worked on data warehousing and ETL tools like Informatica, Talend, and Pentaho

Experience

1. Sr Data Engineer

   Walmart

   Sep 2021 — Present · TX, US

   Developed Spark Applications by using Scala, Java and Implemented Apache Spark data processing Project to handle data from various RDBMS and Streaming sources. Involved in developing Spark code using Scala and Spark-SQL for faster testing and processing of data and exploring of optimizing it using Spark Context, Spark-SQL, Pair RDD\'s, Spark YARN. Developed Kafka consumer API in Scala for consuming data from Kafka topics. Designed and constructed AWS Data pipelines using various resources in AWS including AWS API Gateway to receives response from AWS lambda and retrieve data from snowflake using lambda function and converted the response into Json format using Database as Snow Flake, DynamoDB, AWS Lambda function and AWS S3. Imported data from AWS S3 into Spark RDD, Performed transformations and actions on RDDs. Used Hive QL to analyse the partitioned and bucketed data, Executed Hive queries on Parquet tables, stored in Hive to perform data analysis to meet the business specification logic. Developed Custom Loaders and Storage Classes in PIG to work on several data formats like JSON, XML, CSV and generated Bags for processing using pig etc Continuous monitoring and managing the Hadoop cluster through Cloudera Manager

Education

• University of Memphis

  Master's degree, MIS

• GITAM Deemed University

  Bachelor's degree, Computer Science