Akshitha R

Experience

1. Data Engineer

   Truist

   Mar 2024 — Present · Charlotte, NC, US

   Developed and submitted Spark jobs on AWS EMR clusters using both Scala and Python, ensuringseamless execution of complex data transformations and improving the overall performance oflarge-scale data processing tasks. Leveraged Spark SQL to perform advanced queries on financial datasets, improving the speed andaccuracy of data processing and enabling real-time analytics for banking decision-making andoperational improvements. Optimized resource utilization by analyzing Spark UI metrics and adjusting executor and coreconfigurations, improving cluster efficiency and reducing processing costs. Designed automated workflows by combining Spark with AWS Step Functions, enabling dynamicjob orchestration and error handling across complex ETL processes. Implemented S3 Select with Spark to retrieve subsets of data directly from S3, reducing networkoverhead and improving processing speeds for large datasets. Resolved dependency conflicts by managing transitive dependencies in Maven and SBT, ensuringsmooth integration and deployment of Spark jobs. Optimized Spark SQL queries by using techniques such as predicate pushdown and columnpruning, resulting in faster query execution times and more efficient data processing for large-scaleanalytics.

Education

• University of Cincinnati

  Master's degree