Kavi Bharathi Asokan

Java Spark Developer @Tata Consultancy Services

CA

Designed and developed scalable data processing pipelines using Java and Apache Spark for large-scale batch and streaming workloads• Built and optimized Spark applications using RDD, Data Frame, and Dataset APIs for ETL, data transformation, and analytics use cases• Implemented distributed data processing solutions integrated with the Hadoop ecosystem, ensuring fault tolerance and horizontal scalability• Developed backend services in Java (Spring Boot) to orchestrate Spark jobs and expose REST APIs for data access and workflow management• Optimized Spark performance through efficient partitioning, caching, broadcast joins, and shuffle reduction techniques• Developed Spark Structured Streaming pipelines with checkpointing and exactly-once processing semantics for near real-time data processing• Designed and maintained data ingestion pipelines from relational and NoSQL data sources using JDBC and Kafka for scalable data ingestion• Integrated Spark applications with cloud platforms such as AWS, leveraging object storage services and managed Spark clusters• Automated build, deployment, and monitoring of Spark applications using CI/CD pipelines and logging frameworks

Trent University

Master's degree

Anna University

Bachelor of Engineering - BE