Surya Teja V.

About Surya Teja V.

Experienced Senior Consultant with a demonstrated history of working in financial…

Experience

1. Sr Software Engineer

   Williams-Sonoma, Inc.

   Oct 2018 — Present · San Francisco, CA, US

   Working on the E-Commerce side of the application by developing the Ab Initio graphs and components.• Support existing Ab Initio applications and enhance the graphs for a better run time. • Develop robust Ab initio graphs using industry standard practices.• Lead a team of 6 for project development, enhancement work and constantly meet them for blockers.• Migrate the Ab Initio sandbox folders for old applications into Azure cloud and build pipelines.• Implemented batch processing using Ab Initio GDE and transformation components. • Integrated multiple data pipelines into a streaming process by using Kafka streaming service. • Transformed the data using Scala and Unix scripts by understanding the business requirements.• Worked on end-to-end ETL solutions starting from data collections, integration to data insights using data visualizations tools.• Updated the code to Data frames in Spark for faster performance and to be up to date with the standards.• Automating common tasks in the data pipeline using auto scaling and auto rerun features, which reduces the manual work involved when Azure clusters are down.• Enhancements to the existing applications by optimizing the ETL code using the Bigdata technologies and implementing them in cloud• Working with Bigdata technologies like Hive, Hue, Sqoop, Impala and Pig.• Used Kafka for stream of data from source to destination.

Education

• Harrisburg University of Science and Technology

  Master's degree, Management Information Systems, General

  2017 — 2019

• University of the Cumberlands

  Doctor of Philosophy - PhD, Information Technology

  2019

• The University of Alabama in Huntsville

  Master's degree, Computer Engineering

  2013 — 2014