Sandeep Gande

About Sandeep Gande

Big Data Engineer at Amazon and Graduated in Masters with Big Data Management and…

Experience

1. Big Data Engineer

   Amazon

   Jun 2020 — Present

   Skills: Python, Scala, PySpark, SQL, Amazon Web Services (AWS), Kafka, Data Pipelines, OLAP, Data Modeling, Data Lakes, Performance Tuning, Shell Scripting, Apache Spark, Amazon (Redshift, S3, Kinesis, QuickSight, Datanet), AWS (Glue, IAM, Lambda), CDK, NoSQL, Cloud Computing, Databases, Unstructured Data, Data Analysis, Data Migration, Data Architecture, Data Integration, Datasets, Extract, Transform, Load (ETL), Data Warehousing, Data Models. • Worked on a multi-faceted initiative of building a horizontally scalable and cost-effective Data Lake using AWS Glue, Scala, CDK, and other AWS stacks to migrate the team’s legacy ETL workflows and create an ML feature repository to enable science models to work with both structured and unstructured data • Migrated multiple legacy pipelines to Spark-based modular framework using Spark’s functional API and Spark UDFs • Worked on platform agnostic Data Quality Framework using Python package and integrated with existing pipelines • Worked on optimizing team’s critical pipelines and improved by more than 95%, and average execution time reduced from 500mins to 10mins to meet the SLA on a consistent basis and moved to NAWS. • Worked closely with the salesforce team on the Data Visibility Program project, and created an architecture design to load data into the Data warehouse under the Redshift cluster through Informatica. • Built an End-to-End tool to measure and identify bottlenecks for the Data Availability of team important pipelines using Python, Redshift, and Datanet tools. And achieved the goal of 90% SLA within a short period of time. • Developed a Ticket Score Tool to help teams across Amazon monitor & and achieve their ticket score organization goal using Python, Redshift, and Tableau. Provided this tool as a service to other teams across Amazon. • Automated IMR cost analysis process for the entire org using Python, which reduced 98% manual effort from 4hrs to 5mins and saved more than $150K savings per year.

Skills

• Python
• C
• C++
• Microsoft Office
• Tableau
• Ms Excel Pivot Tables
• Jsp
• Hadoop
• Research
• Forecasting
• Mysql
• Microsoft Sql Server
• Requirements Analysis
• Statistical Data Analysis
• Eclipse
• Analytical Skills
• D3.js
• Big Data Analytics
• Pl/Sql
• Javascript
• Html
• Wordpress
• R
• Business Analysis
• Mathematics
• Microsoft Excel
• Data Analysis
• Sdlc
• Jsf
• Jenkins
• Java
• Core Java
• Jira
• Tortoise Svn
• Web Applications
• Big Data
• Business Intelligence
• Apache Spark
• Windows
• Project Management