Sowmyakam
Kafka Engineer @American Express
Signup · Get unlimited contacts
WORK HISTORY
Kafka Engineer @American Express
Developed Kafka producer and consumers, HBase clients, Spark jobs using scala API’s along with components on HDFS, Hive.• Automating and scheduling the Sqoop jobs in a timely manner using Unix Shell Scripts. Used SCRUM for agile development and participate in team-led solutions, reviewing peer\'s code for quality and completeness. Involved in identifying job dependencies to design workflow for Oozie & YARN resource management.• Responsible for managing existing data extraction jobs, but also play a vital role in building new data pipelines from various structured and unstructured sources into Hadoop. work on a product team using Agile Scrum methodology to design, develop, deploy and support solutions that leverage the Client big data platform.• Integrated Apache Spark with Kafka to perform web analytics. Uploaded click stream data from Kafka to Hdfs, HBase and Hive by integrating with Spark.• Design and code from specifications, analyzes, evaluates, tests, debugs, documents, and implements complex software apps.• Developed Sqoop Scripts to extract data from DB2 EDW source databases onto HDFS. Worked in tuning Hive & Pig to improve performance and solved performance issues in both scripts with understanding of Joins, Group and aggregation and how does it translate to Map Reduce jobs• Created Partitions, Buckets based on State to further process using Bucket based Hive joins.• Implemented Cloudera Manager on existing cluster.• Extensively worked with Cloudera Distribution Hadoop, CDH 5.x, CDH4.x.• Troubleshooting experience in debugging and fixed the wrong data or data missing problem for both Oracle Database and Teradata.Deployed various Micro services like Spark, MongoDB, and Cassandra in Kubernetes and Hadoop clusters using Docker.
EDUCATION
Jawaharlal Nehru Technological University
Bachelor's degree, Computer Science
Atlantis University
Master's degree, Information Technology
ABOUT SOWMYAKAM
Currently working as a Sr. Java developer with reactJS on the Frontend in Lowe\'s for parcel pay application. Expert in ReactJS, Redux, Redux-saga, Javascript, Bootstrap, CSS3, HTML5, Java, Springboot, Spring MVC.etc.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.