Ghali Rahma

Ingénieur Devops Bigdata @Orange

Cloudera administration Trainer - Deploy Docker containers - Manage Kafka Brokers clusters at the level (topic creation, rebalancing)- Following and coordination of the project jointly with the Project Manager, defining Roadmap, architecture and specification, writing technical documentation- Support and administration of Hadoop and all components around HDFS Kafka Grafana Prometheus and Hue- Automation of the infrastructure with ansible, scripting the creation of Cluster, automation of monitoring - Deployment of Grafana services node exporter Prometheus with Ansible,Docker - Deployment and Configuration Ansible AWX - Develop, Install and configure Tools- Support the development teams for solving the networks - Implementation of a data integration flow in Batch mode, in streaming mode and in change data capture mode with Talend ETL, Kafka sink and source connectors, Spring Boot Listners- Provide data with proper format and schema and perform data quality check- Application level pre-processing / kafka Streams- Securing the Kafka cluster (TLS, SASL, ACL with the operator Kooperator banzaicloud)- Perform Kafka performance tests- Management of topics, Kafka connectors… via the command line or via Kafka monitoring user interface tools - Reliability and security of Kafka clients- Design of streaming data pipelines- Optimization of reading/writing of MongoDB databases (embedded documents, indexing.)- Optimization of data flows in consumption and production- Integration and continuous deployment of microservices with Gitlab cicd- Deployment of microservices on K8 ( dockerfile, helm )- Application monitoring with Prometheus