Aki

About Aki

Professional IT experience in Data Warehousing, ETL (Extract, Transform, and Load) and Data Analytics.Extensive experience in Informatica Power Center 10.x/9.x/8.x. 3 years as Lead Developer, responsible for supporting enterprise level ETL architecture.3+ years of experience in Hadoop 2.0. Led development of enterprise level solutions utilizing Hadoop utilities such as Spark, MapReduce, Sqoop, PIG, Hive, HBase, Phoenix, Oozie, Flume, streaming jars, Custom SerDe, etc. Worked on proof of concepts on Kafka, and Storm.Big data systems- Snowflake, Aurora, Apache Hadoop and the Hadoop Ecosystem, Apache Spark and ETL.Front end- Javascript, react, angular.Query Languages: SQL, PL/SQL, HQL. PowerShell, BOT FrameworkAWS Services: EC2, S3, VPC, ELB, IAM, Glacier, Aurora, RDS, DynamoDB, Cloud Front, Cloud Watch, Terraform, Route 53, Elastic Beanstalk (EBS), AutoScaling, Security Groups, EC2 Container Service (ECS), Code Commit, Code Pipeline, CodeBuild, Code Deploy, Dynamo DB, Auto Scaling, Security Groups, Red shift, CloudWatch, CloudFormation, CloudTrail, OpsWorks, Kinesis, IAM, SQS, SNS, SES.Languages: C, C++ with OOPS, Java1.6/1.7/1.8, J2EE 1.3/1.4/5.0, Javascript, Angular, React, Node.Build tools: Jenkins,Maven,JIRAWeb tools and languages: HTML5, XML, CSS3, DHTML, HTML, AJAX, ANT, Java Script, WSDL.Framework: Design Patterns, SOAP, MVC, Struts, Hibernate, Spring

Experience

1. Senior Data Engineer

   Acoustic

   Jul 2019 — Present · Boston, MA, US

   Used advanced java 8 features like Lambda expressions for array operations, collections and deployed applications on AWS by using Elastic Beanstalk and integrated Web Application using Amazon Web Services (AWS) collection of digital infrastructure services during development of java applications.•In Big Data, implemented solutions for ingesting data from various sources and processing the Data-at-Rest utilizing Big Data technologies such as Hadoop, MapReduce Frameworks, MongoDB, Hive, Oozie, Flume, Sqoop and Talend etc.•Designed, Developed and Implemented the J2EE Micro services on AWS EKS using the Kubernetes, Docker CE and Jenkins CI pipeline.•Implemented design patterns in Scala for the application. Develop quality code adhering to Scala coding Standards and best practices.•Exposed Rest based web service using apache CXF on top of JAX-RS. Created Proxy plug-ins using Apache/iPlanet/IIS WebLogic servers.•Wrote Google Data Flow jobs using apache beam to move data from BiqQuery to Spanner and Google Pub Sub to AWS.•Involved in ingesting data into IDW staging directly from BEAM,(an inbuilt component for ingesting real time data into Hadoop) using Apache Storm to push data into HDFS.•Lead Migration from GCP to AWS using App Engine MapReduce to Apache Beam and Dataflow. Implemented an REST to AMQP interface for RabbitMQ using Node.js and the RabbitMQ Java AMQP API.•Automated RabbitMQ cluster installations and configuration using Java and created Terraform scripts for EC2 instances, Elastic Load balancers and S3 buckets. •Imported the data from different sources like HDFS/Hbase into SparkRDD. Load and transform large sets of structured, semi structured and unstructured data using Hadoop/Big Data concepts.•Involved in converting MapReduce programs into Spark transformations using Spark RDD\'s on Scala. Worked on analyzing Hadoop cluster using different big data analytic tools including Kafka, Pig, Hive and MapReduce.