Nagarjuna Vissarapu

About Nagarjuna Vissarapu

As a seasoned Data Engineer with over a decade of comprehensive experience in Information Technology, I specialize in leveraging the synergy between big data frameworks and cloud technologies to drive transformative solutions. My proficiency spans across Hadoop, Spark, Databricks, SQL, and Python, coupled with a robust command over cloud platforms.My career journey has been dedicated to optimizing data pipelines, spearheading migration projects to cloud environments, and orchestrating advanced data transformations. I\'ve consistently excelled in enhancing operational efficiency, resolving intricate challenges, and unlocking actionable insights from complex datasets.My passion lies in harnessing the power of technology to not only solve problems but to innovate and drive scalable solutions. I thrive in dynamic environments, embracing challenges with a solution-oriented mindset and a commitment to continuous learning.I am seeking opportunities to collaborate with visionary teams, leveraging my expertise in big data and cloud technologies to pioneer innovative solutions that redefine industry standards and drive tangible business outcomes.Let\'s connect and explore synergies in transforming data into strategic assets that propel businesses towards unparalleled success.

Experience

1. Senior Consultant

   CGI

   Apr 2023 — Present · US

   Collaborated with team on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.Employed data cleansing methods such as dropping duplicates, Remove irrelevant data, and Handle missing values, significantly enhancing data quality.Translates business specifications into design specifications and code using Shell script, Hive Hqls, Python and Spark. Responsible for writing complex programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.Involved in project migration from Hadoop to Cloud platform.Automated ETL process across billion of rows data.Migrated NAS drive data to Cloud Storage and setting storage classes for data retention.Implemented Spark Core and Spark SQL modules in Spark.Implemented analytics transformations using Spark.Implemented Persistance, Broad cast, Partition Pruning and other optimizing techniques.Used DataFrames to read the data from Hive tables and implemented transformations on top of it.Stored final data from DataFrame to HIVE tables in parquet format.Implemented multiple jobs sequentially into one logical unit of work using Oozie.Utilized the rest call feature of OozieImplemented shell scripts to trigger curl command and to track the running job logs.Implemented CA workstation for job schedulesUtilized Jenkins for CICD implementationInvolved in PVS and Production deployment activities complete cycle.Agile methodology and implementation.

Education

• SSNEngineering College

  Bachelor of Engineering (BEng), Information Technology

  2007 — 2011