Akbar Habib Khan
Technical Manager - Big Data | Big Data Architect | DataOps/DevOps Advocate | AWS CloudOps Specialist
- Role
- Technical Manager - Big Data at Capgemini
- Location
- Pune District, MH, IN
- LinkedIn followers
- 500 followers
About Akbar Habib Khan
KEY SKILLS: Enterprise Distribution: Cloudera CDH/CDP and Apache Hadoop, EMRServices: HDFS, YARN, MapReduce, Hive, Kafka, Sqoop, Spark, Impala, Zookeeper, FlumeDevOps Tools : Ansible, Jenkin, Docker, Git-GitHub, TerraformCloud Platform: Amazon Web Services Security: MIT & AD Kerberos, Apache Sentry, KMS, Extended ACL, Sticky Bits and Encryption (motion/rest)Expertise, Roles and Responsibilities- Highly motivated and enthusiastic Hadoop Admin professional with 7.7 years of experience in IT and 5.8 years in Big data Hadoop administration such as Deployment, Configuration, Migration, Upgrade, Monitoring, Troubleshooting and Securing Hadoop Clusters using different distribution like Apache Hadoop and Cloudera CDH/CDP- Expertise in working on Big Data components like HDFS, YARN, MapReduce, Hive,Hue, Kafka, Streamsets, Sqoop, Flume, Zookeeper, Spark, Impala, Airflow, Oozie, Git and GitHub, etc. in production cluster- Configured Security features for Authentication Using Kerberos (MIT & AD)- Role Based, Authorization Using Sentry, and Extended ACL for HDFS, Authorization at POSIX Level and using sticky bits, Data at Rest Encryption Using KMS & KTS- Experienced in creating Real-time Data Integration pipelines using Streamsets and Kafka- Experienced in deploying, configuring, monitoring, troubleshooting Kafka Clusters- Manage Cloud Service Platform of AWS like S3, EC2, EBS, VPC, EFS, AMI, EMR, IAM, Snapshots, Cloudwatch- Configured and managed Cloudera Platform & Services like CM and CDH, Production Ready Features Like HA for HDFS, HA for YARN,HA for HIVE(HS2 & HMS),Architecture and Workflow- Configure and Administrating cluster to cloud BDR in Production Environment with Alerts- Experienced in deploying, configuring, maintaining, monitoring, troubleshooting & performance tuning of Spark on Cloudera- Expertise in Commissioning, decommissioning, Balancing and Managing Nodes and tuning server for optimal performance of the cluster, Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting- Good Experience in Planning, Installing and Configuring Hadoop Cluster in Apache Hadoop and Cloudera Distributions- Hands on the Linux server CLI for monitoring and maintaining the Hadoop cluster configurations, Configured third-party tool for cloudera and add third-party custom services for cloudera- Successfully deploy and configured CDP (cloud Data Platform) cluster Environment for team to start POC on that- Performed POC on Confluent Kafka-experience in BDR for Big Data Cluster.
Experience
Technical Manager - Big Data
Oct 2024 — Present · Pune, IN
Education
Sant Gadge Baba Amravati University, Amravati
Batchelor in Engineering
Maharashtra State Board of Secondary and Higher Secondary Education (MSBSHSE)
HSC Science , Science
M.G.M's Jawaharlal Nehru College of Engineering
Master of Technology - MTech
Maharashtra State Board of Secondary and Higher Secondary Education (MSBSHSE)
SSC 10th , Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.