Nagaraju B

Experience

1. Senior Data Engineer

   Global Atlantic

   Mar 2022 — Present · Indianapolis, IN, US

   Worked on building centralized Data Lake on AWS Cloud utilizing primary services like S3, EMR, Redshift and Athena.\\\\n• Worked on migrating datasets and ETL workloads from On-prem to AWS Cloud services.\\\\n• Built series of Spark Applications and Hive scripts to produce various analytical datasets needed for digital marketing teams.\\\\n• Worked extensively on building and automating data ingestion pipelines and moving terabytes of data from existing data warehouses to cloud.\\\\n• Worked extensively on fine tuning spark applications and providing production support to various pipelines running in production.\\\\n• Worked closely with business teams and data science teams and ensured all the requirements are translated accurately into our data pipelines.\\\\n• Worked on writing different RDD (Resilient Distributed Datasets) transformations and actions using Scala Spark.\\\\n• Worked on full spectrum of data engineering pipelines: data ingestion, data transformations and data analysis/consumption.\\\\n• Developed Spark scripts by using Python shell commands as per the requirement.\\\\n• Implemented Spark using Scala and Spark SQL for faster testing and processing of data.\\\\n \\\\n\\\\n \\\\n \\\\n\\\\n \\\\n