Akhil K

WORK HISTORY

ABOUT AKHIL K

A Data Engineer with overall 9 years of expertise in ETL, Big Data, Python/Scala, Relational Database Management Systems (RDBMS), and enterprise-level cloud computing and apps.• Expertise in Big Data technologies and Hadoop ecosystems such as PYSPARK, SPARKSCALA, HDFS, GPFS, HIVE, SQOOP, PIG, SPARKSQL, KAFKA, HUE, YARN, TRIFACTA and EPIC data sources.• Experience with developing User Defined Functions (UDFs) in Apache Hive using Java, Scala, and Python.• Experienced in performing in-memory data processing for batch, real-time, and advanced analytics using Apache Spark (Spark Core, Spark SQL, and Streaming).• Ingested data into Hadoop from various data sources like Oracle, MySQL, and Teradata using Sqoop tool. • Experienced in Agile and Waterfall methodologies in Project execution.• Strong knowledge in NoSQL column-oriented databases like HBase and their integration with Hadoop.• Extensive experience working with AWS Cloud services and AWS SDK’s to work with services like AWS API Gateway, Lambda, S3, IAM and EC2.• Customized the dashboards and managed user and group permissions on Identity and Access Management (IAM) in AWS.• Experience in data process and analysis using Map Reduce, HiveQL• Extensive experience in Writing User Defined Functions (UDFs) in Hive and Pig.• Worked on Apache Sqoop to perform importing and exporting data from HDFS to RDBMS/NoSQL DBs and vice-versa.