Sanket Shah
- Role
- Big Data Administrator at Renaissance Learning
- Location
- Minneapolis, MN, US
- LinkedIn followers
- 500 followers
About Sanket Shah
10+ years of IT experience including experience related to various Bigdata/Cloud/NoSQL…
Experience
Big Data Administrator
Dec 2014 — Present · Minneapolis, MN, US
Fully Automated Hadoop cluster provisioning process using Cloudera Manager API, Ansible and pxeboot and terraform either at on-premises or in the cloud. • Wrote Logstash configuration file/custom Logstash filters as needed to manage various Hadoop related logs and to build Kibana dashboards out of them. • Provision mongo, Elastic-search, Zookeeper, Solr-Cloud cluster as needed • Tuned mongo queries, Hadoop (Map reduce, PIG and Hive) jobs as needed. • Wrote dockerized python app responsible for migrating MongoDB docs from one replica set to another replica set based on provided databases/collections. • Wrote terraform modules/Ansible plays so MongoDB replica set can be provisioned on the AWS using one click Jenkins job. • Implemented elasticity in AWS for MongoDB cluster. Instance type of MongoDB ec2 instances can be changed with one click in Jenkins UI without any downtime. • Implemented immutable infrastructure for MongoDB and SolrCloud in AWS. Os patches, the upgraded version of MongoDB can be baked into ami. Newly baked ami can be rolled out with one click at Jenkins without any downtime. • Implemented elasticity for Solr-Cloud in aws. A number of ec2 instances would scale up and scale down automatically upon increase/decrease in load. • Imported data from SQL server to HBase using Sqoop and hive external tables. • Wrote and maintained various ETL/ELT pipeline involving various Bigdata/NoSQL/Cloud technologies • Designed and implemented a migration strategy for ~70TB data stored in various MongoDB replica sets at on-premises datacenter to aws. • Extracted data out of mongo, HBase, hive using various tools as requested by engineering/BI team. • Implemented Nagios from scratch to monitor Linux nodes and various NoSQL DBS. • Implemented Spacewalk from scratch (using Spacewalk, TeamCity,and Ansible, Big-Data jobs can be deployed in continuous deployment model as needed) • Wrote RPM spec file and Docker file as needed to deploy software professionally
Education
University of Florida
M.S ( Master of Science), Systems Engineering (Technical Focus in Information Science), 3.66
2008 — 2010
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.