Vinod Uppa
Sr Aws Data Engineer @Great American Insurance Group
Signup · Get unlimited contacts
WORK HISTORY
Sr Aws Data Engineer @Great American Insurance Group
TX, US
Developed Spark Applications by using Python and Implemented Apache Spark data processing Project to handle data from various RDBMS and Streaming sources. Responsible for building scalable distributed data solutions using Hadoop. Built NiFi dataflow to consume data from Kafka, make transformations on data, place in HDFS and exposed port to run spark streaming job. Migrated an existing on-premises application to AWS platform using various. Consumed Extensible Markup Language (XML) messages using Kafka and processed the XML file using Spark Streaming to capture User Interface (UI) updates. Loaded data into S3 buckets using AWS Glue and PySpark. Involved in filtering data stored in S3 buckets using Elasticsearch and loaded data into Hive external tables.• Utilized Google Cloud Storage as data lake and ensured all the processed data is written to GCS directly from spark and hive jobs Google Cloud Platform (GCP) using cloud native tools such as BIG query, Cloud Data proc, Google Cloud Storage, Composer.
EDUCATION
SIDDARTHA COLLEGE OF EDUCATION, Hanuman junction
holymary Institute of Technology, Mechanical Engineering
ABOUT VINOD UPPA
Having experience as a Big Data Engineer with expertise in designing data intensive applications using Hadoop Ecosystem, Big Data Analytical, Cloud Data engineering, Data Warehouse/ Data Mart, Data Visualization, Reporting, and Data Quality solutions.• Extensive experience in Hadoop led development of enterprise level solutions utilizing Hadoop components such as Apache Spark, MapReduce, HDFS, Sqoop, PIG, Hive, HBase, Oozie, Flume, NiFi, Kafka, Zookeeper, and YARN.• Experienced with the Spark improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Data frame API, Spark Streaming, MLlib, Pair RDD\'s and worked explicitly on PySpark and Scala
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.