Vamsi V

Role
Senior Data Engineer at Citrix
Location
Overland Park, KS, US
LinkedIn followers
500 followers

About Vamsi V

An Experienced and Motivated professional currently working as Data Engineer. Around…

Experience

  1. Senior Data Engineer

    Citrix

    Apr 2021 — Present

    Involved in high level architecture design for migration of transformation of transactional data to HDFS. Created external, partitioned hive tables and corresponding HDFS locations to house data. Create shell scripts to automate data ingestion jobs and processing data. Create Python wrapper scripts which act as framework and are utilized by all jobs in the Transaction Data Hub. Create Oozie Workflow Engine in running workflow jobs with actions that run Hadoop Map Reduce and Spark Jobs, execute python and shell scripts. Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs, Python and Scala. Design Batch ingestion components using Sqoop scripts, data integration and processing components using shell scripts, pig scripts, hive scripts. Performed advanced procedures like text analytics and processing, using the in-memory computing capabilities of Spark using Scala. Create PySpark scripts to transform and write data to HDFS. Use Spark SQL and data frames for transforming data on a large scale. Streamed data from Kafka topics Performed the migration of Hive and MapReduce Jobs from on - premises Cloudera to AWS cloud using EMR and Delta Lake Create CA7 packages in mainframes for scheduling the Jobs. Implement Kafka streaming to ingest data in near real time. Review and merge pull requests in Bitbucket. Work with Jenkins pipeline, deploy to automate the Build and deploy process. Work closely with the testing team to create unit test cases. Use Impala to create complex queries to analyze the transaction data. Worked in Agile Scrum methodology Work closely with Product manager for release planning

Find verified contacts for anyone on LinkedIn

Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.

Free plan included · No credit card required

This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.

Vamsi V — Senior Data Engineer at Citrix in Overland Park, KS, US | Unifers