Karthik Kannan

About Karthik Kannan

I am an IT professional with 12+ years of experience in Data Engineering technologies. Currently, I am working for Amazon as Data Engineer.I am an IBM certified solution developer having advanced level of expertise in Data Engineering, ETL tools, Python, AWS services like S3, EC2, lambda, SQS, SNS, secrets manager, data pipeline, Big Data technologies like Spark, Sqoop, Hive, Flume, Python, SQL, Data-warehousing, Data Modeling, Business Intelligence, Analytics and CICD processI am currently seeking an opportunity in an industry where I can utilize my technical knowledge, logical and analytical skills that will greatly enhance an industries success and growthMy areas of interests are :Data Engineering, ETL, Data Warehousing, Big Data Technologies, Data Analytics, Business Intelligence and Business data visualization

Experience

1. Data Engineer

   Amazon

   Aug 2019 — Present · NY, US

   Designed and implemented scalable data lake architecture using AWS technologies (S3, Glue, Crawler, Lambda, Athena, Airflow, SQS, Lake Formation, IAM, etc), to consolidate diverse data sources and support seamless data discovery, access, and analytics.• Designed and implemented scalable ETL pipelines using Apache Spark, Python and SQL to process large-scale datasets efficiently, enabling high-performance data transformations and analytics in big data environments.• Familiar with Scala for data processing tasks, providing flexibility in choosing the appropriate language for specific project requirements.• Extensive experience in implementing and maintaining a robust data warehouse infrastructure using AWS Redshift and Spectrum to store and manage large-scale datasets, enabling efficient data querying, analytics, and reporting for business stakeholders.• Built real-time data pipeline leveraging AWS SQS, Lambda, S3, and OpenSearch to enable low-latency data ingestion, processing, and search capabilities• Demonstrated expertise in writing Infrastructure as Code (IaC) using AWS Cloud Development Kit (CDK) with TypeScript, enabling efficient, reusable, and scalable deployment of AWS resources.• Designed and implemented data integration solutions, transferring data from Salesforce to a Redshift data warehouse using ETL Informatica Cloud• Designed and developed interactive dashboards with AWS QuickSight and Tableau

Education

• Anna University - Velammal Engineering College

  Bachelor's degree, Electronics and Instrumentation

  2007 — 2011

• University of Illinois Chicago-College of Business Administration

  Master's degree, Management Information Systems, General

  2014 — 2015

Skills

• Ibm Infosphere Datastage 8.5
• Ibm Infosphere Datastage 8.0
• Business Analysis
• Databases
• Mysql
• Data Analysis
• Data Warehousing
• Business Intelligence
• Html
• Css
• Microsoft Office
• Javascript
• Project Management
• R
• Sas
• System Administration
• Team Management
• Marketing
• Marketing Strategy
• Software Project Management
• Consulting
• Management Consulting
• Core Java
• Sdlc
• Sql
• Java
• Extract, Transform, Load (Etl)
• Etl
• Apache Spark
• Spark
• Python
• Hive
• Flume
• Big Data
• Hadoop
• Kakfa
• Sqoop
• Hdfs
• Teradata
• Greenplum