Shiva B
Data Engineer and Big data Hadoop Developer |Actively seeking C2C positions | 5+ in Big Data | Python | Scala | Java | AWS | Hadoop | Hive | Spark | Kafka | HDFS | Map Reduce | ETL /Sqoop /MongoDB |AWS glue| Snowflake
- Role
- Data Engineer at Airbiquity
- Location
- New York, NY, US
- LinkedIn followers
- 500 followers
About Shiva B
Looking for c2c-Around 7+ years of programming experience involved in all phases of Software Development Life Cycle (SDLC)-Over 4+ Years of Big Data experience in building highly scalable data analytics applications-Strong experience working with Hadoop ecosystem components like HDFS, Map Reduce, Spark, HBase, Oozie, Hive, Sqoop, Pig, Flume and Kafka-Good hands-on experiencing working with various Hadoop distributions mainly Cloudera (CDH), Hortonworks (HDP) and Amazon EMR-Good understanding of Distributed Systems architecture and design principles behind Parallel Computing-Expertise in developing production ready Spark applications utilizing Spark-Core, Data Frames, Spark-SQL, Spark-ML and Spark-Streaming API\'s- Strong experience troubleshooting failures in spark applications and fine-tuning spark applications and hive queries for better performance-Worked extensively on Hive for building complex data analytical applications- Strong experience writing complex map-reduce jobs including development of custom Input Formats and custom Record Readers.
Experience
Data Engineer
Oct 2021 — Present · Seattle, WA, US
Developed custom multi-threaded Java based ingestion jobs as well as Sqoop jobs foringesting from FTP servers and data warehouses.Wrote Kafka producers to stream the data from external rest APIs to Kafka topics. Wrote Spark-Streaming applications to consume the data from Kafka topics and write theprocessed streams to HBase.
Education
Osmania University
Bachelor's degree, Engineering
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.