Saarim Shaikh

About Saarim Shaikh

Software Engineer with 3+ years of professional experience specializing in big data…

Experience

1. Software Engineer

   Richclouding Software Solutions

   Mar 2022 — Present · Maharashtra, IN

   Deployed Hadoop clusters in AWS environments.• Managed and scaled cloud-based infrastructure on AWS, including EC2, S3, and EMR, ensuring high availability and cost efficiency.• Monitored system performance using Cloudera Manager and AWS CloudWatch.• Documented platform-related procedures and best practices, improving team efficiency and knowledge sharing.• Maintained data ingestion frameworks using Apache NiFi and Sqoop to streamline data collection from diverse sources, ensuring dataaccuracy and consistency.• Deployed real-time data processing systems using Apache Kafka and Spark Streaming, enabling real-time analytics and reporting forbusiness stakeholders.• Configured and managed Hadoop clusters using Cloudera Manager, ensuring optimal performance and resource utilization acrossdistributed systems.• Automated infrastructure provisioning and management using Terraform, reducing manual intervention and improving deploymentconsistency.• Orchestrated containerized applications using Kubernetes, ensuring high availability, scalability, and efficient resource allocation.• Implemented encryption zones in Hadoop to ensure data security and compliance with organizational policies.• Conducted root cause analysis (RCA) for production incidents, implementing preventive measures to avoid recurrence and improve systemreliability.• Developed and maintained ETL workflows using Oozie, ensuring timely and accurate data processing for downstream applications.• Implemented disaster recovery and backup strategies for critical data and systems, ensuring business continuity in case of failures.• Responsible for managing client configuration in the Cloudera cluster.• Implemented, and maintained CI/CD pipelines using Jenkins to automate the build, test, and deployment processes.• Configured Kafka topics and implemented data retention policies.• Configured Jenkins to trigger automated builds and deployments based on GitHub webhooks, enabling continuous integration.