Rishu R.

About Rishu R.

Greetings! I\'m Rishu Raj, a seasoned Data Engineer with a strong foundation in Computer…

Experience

1. Software Developer

   ArabyAds

   Dec 2023 — Present

   As a Data Engineer at ArabyAds, I am at the forefront of architecting and managing data pipelines, ensuring seamless data ingestion, processing, and analysis. Leveraging a robust skill set and cutting-edge technologies, I contribute to the development of scalable and efficient data solutions.Responsibilities: Data Pipeline Architecture: Design and implement end-to-end pipelines for ingesting, transforming, and loading data from diverse sources. Data Processing: Use Kafka, Spark, and Hadoop for processing and analyzing data at scale, extracting valuable insights. Integration and Orchestration: Seamlessly integrate data using Kafka Connect, and orchestrate workflows with tools like Airflow. Big Data Ecosystem Management: Manage and optimise Hadoop ecosystem components like HDFS, YARN, and MapReduce. Data Security and Compliance: Implement data security measures and ensure compliance with regulations.Achievements: Scalable Pipelines: Reduced processing time. Data Quality Improvement: Decreased data errors through enhanced quality checks. Innovative Solutions: Introduced real-time processing, enhancing data capabilities. Performance Optimization: Improved processing speed through algorithm optimization. Streamlined Integration: Automated ingestion processes, increasing efficiency.Skills: Big Data Technologies: Hadoop, Spark, Kafka. Data Integration: Kafka Connect, Oozie.🧪 Testing and Optimization: Troubleshooting, performance optimization. Database: MariaDB, Greenplum and Aerospike Problem-solving: Complex challenges resolution.

Education

• D.A.V. Public School

  Matriculation

• Birla Institute of Technology, Mesra

  Bachelor of Technology - BTech, Computer Science

• Shivam Public School

  Intermediate