Ranjith Gangam

About Ranjith Gangam

14 years of Programming experience in Python, Scala and Java. • 6 years of experience in Big data technologies like Spark, SparkSQL,Spark Streaming, Structure streaming, Amazon EMR, Kafka, Pig, Hive, Sqoop, Oozie, Flume.• Hortonworks Certified Spark developer (HPDCD-Spark)• Experience in handling realtime data using Spark streaming and structured streaming.• Experience in handling realtime retail transactions and generating realtime reports using Spark, Spark streaming and Tableau• Experience in performing ETL activities using Spark and Spark SQL• Good experience in handling Healthcare and retail domain data.• Experience in developing DataMart using SQL on Netezza and on Hadoop HDFS and on S3 using Spark• Worked on several apaches Hadoop projects. Wrote Map reduce programs in Java and Python.• Proficient in Python, Java, Scala.• Worked in cloud technologies like Amazon web services and Google cloud.• Built RESTful Web services using JAX-RS API.• Generated useful insights from social media data and made reports using Tableau.

Experience

1. Lead Data Engineer

   84.51˚

   Jul 2022 — Present

   Built data pipelines on the azure cloud using azure databricks, pyspark, Azure blob storage, Kafka, and Azure Data factoryDeveloped data pipeline using HDFS, Spark, Sqoop, Airflow scheduler, and Nifi on-premise Cloudera cluster. Automated the Databricks jobs using Azure Data Factory(ADF) Delivered data as a service by building api’s in Python. Wrote databricks spark jobs in Python and wrote API using Fast API framework and unit tested them Worked closely with Data scientists and stakeholders. Built apis to capture the inputs from stakeholders and run science in Kubernetes and delivered the data as a service. Implement Continous Integration and delivery pipeline(CI/CD) by using GitHub actions and TeamCity.Written Terraform scripts to spin up cloud resources like Mongo DB, Azure Data Factory, MongoDB, Postgres. Captured the varying/dynamic requests from API calls in MongoDB and built a process to validate the requests.

Education

• University of Cincinnati

  Master’s Degree, Computer Science

  2015 — 2016

• Jawaharlal Nehru Technological University

  Bachelor’s Degree, Computer Science

  2006 — 2010

• University of Cincinnati

  Data Science Certification, Data Modeling/Warehousing and Database Administration

  2015 — 2016

Skills

• Apache Spark
• Sparql
• Hive
• Scala
• Python
• Big Data
• Healthcare
• Hadoop
• Mapreduce
• Health Insurance
• Data Science
• Big Data Analytics
• Apache Pig
• Hbase
• Amazon Web Services (Aws)
• Machine Learning
• Tableau
• Java
• Sas Programming
• Sas
• Software Development
• R
• Data Warehousing
• Programming
• Cloudera Impala
• C++
• Linear Regression
• Regression Models
• Data Analytics
• Data Mining
• C
• Amazon S3
• Sql
• Star Schema
• Dimensional Modeling
• Amazon Ec2
• Html
• Testing
• Unix