Rineeth N

About Rineeth N

Data Engineer knowledge seeker, working on improving my machine learning and statistical skills to deal with different types and sizes of data. The aim of my career is to optimize already found solutions and find effective mathematical solutions to the business problem using machine learning algorithms. My current focus is to find the best way to work with large datasets using Spark and Python, to optimally use the computing power of the available machine memory Over the years, I diverse my skill sets in software, digital marketing, and finance fields. My roles changed from a software engineer to senior data analyst. Key Skills : Python, EMR, Snowflake, Big Data, Salesforce, Machine Learning, Statistics Pyspark, AWS S3, EC2, GCP, R, SQL, Tableau, RDBMS, Oracle VirtualBox Email: n••••••••@gmail.com

Experience

1. Senior Big Data Engineer

   Vanguard

   Aug 2020 — Present · US

   Partnered with ETL developers to ensure that data is well cleaned, and the data warehouse is up to date. Selected and generated data into CSV files and stored them into AWS S3 by using AWS EC2 and then structured and stored in AWS Redshift. Data Extraction, aggregations, and consolidation of Adobe data within AWS Glue using PySpark. Worked with AWS cloud platform and its features which include EC2, IAM, EBS CloudWatch and AWS S3 Deployed application using AWS EC2 standard deployment techniques and worked on AWS infrastructure and automation. Worked on CI/CD environment on deploying application on Docker containers. Used AWS S3 Buckets to store the file and injected the files into Snowflake tables using Snow Pipe and run deltas using Data pipelines. Processed some simple statistical analysis of data profiling like cancel rate, var, skew, kurt of trades, and runs of each stock everyday group by 1 min, 5 min, and 15 min. Used PySpark and Pandas to calculate the moving average and RSI score of the stocks and generated them into data warehouse. Exploring with Spark to improve the performance and optimization of the existing algorithms in Hadoop using Spark context, Spark-SQL, postgreSQL, Data Frame,OpenShift, Talend, pair RDD\'s Involved in integration of Hadoop cluster with spark engine to perform BATCH and GRAPHX operations. Developed and validated machine learning models including Ridge and Lasso regression for predicting total amount of trade. Boosted the performance of regression models by applying polynomial transformation and feature selection and used those methods to select stocks. Generated report on predictive analytics using Python and Tableau including visualizing model performance and prediction results. Utilized Agile and Scrum methodology for team and project management. Used Git for version control with colleagues.

Education

• Anna University

  Bachelor's degree, Computer Science

  2009 — 2013