Abhishek Gupta

About Abhishek Gupta

Strong experience in architecture and design of BigData use cases covering- security architecture, data storage & transformation architecture, data consumption architecture, monitoring and alerting framework- Strong knowledge in performance tuning and configuring of big data stack of technologies- Strong knowledge in working with third party big data tools like - visualization tools, Data ingestion tools- Highly Available (HA) setup and Disaster Recovery architecture for Hadoop clusters using active-active and active-passive setup- Experience in architecting and performance tuning very large hadoop clusters 800+ nodes- Experience in driving large scale projects towards successful implementationWorked on multiple AWS technologies(DynamoDB, S3, EC2, Route 53, Cloudformation, Security Groups, Lambda).Application development in Spark(Scala, Python, Hadoop, Hive) based Big data projects.Designing the data pipeline for several projects.Leading a Big data team/project to migrate from Hadoop based architecture to AWS-Databricks based architecture (3 phases done).Setup new env in AWS and Big data pipe line for Client.Several optimizations done specially in Hive/Spark/Scala code. Upto 50% cost, time saved in recent optimizations.Create CICD pipeline using Jenkins.Championed several initiatives project within CVS Caremark, most notable being responsible and accountable for delivering a utility that saves CVS $35 million annually and also avoid sanction which could have resulted in loosing whole MedD business worth $500 million.Past experience includes Mainframe development and manual testing.

Experience

1. Software Engineering Manager

   Comcast

   Nov 2021 — Present · New York, NY, US

Education

• Institute of Management Technology, Ghaziabad

  Master of Business Administration - MBA

  2014 — 2017

• Ambedkar DSEU Shakarpur Campus-I

  Bachelor's degree, Electrical, Electronics and Communications Engineering

  2003 — 2007

Skills

• Nosql, Oracle, Db2, Ims Database, Mongodb, Hbase
• Hadoop, Mapreduce, Hdfs, Hbase, Mongo Db, Zookeeper, Hive, Pig, Zkfc
• Apache, Yum, Rpm
• Chef Cookbooks, Small Shell Scripts, Pig Basics, Cobol, Cics, Vsam, Db2, Ims, Jc
• Apache: Hadoop Map Reduce, Yarn, Pig, Hive, Sqoop, Flume, Oozie, Zookeeper, Hbas
• Mainframe: Z/Os, Endeavor, Xpeditor, Ibm Debugger, Ibm Fileaid, Changeman, Ibm D
• Healthcare Tool: Facets, Qnxt, Fazal
• Unix
• Sql
• Sdlc
• Technical Recruiting
• Databases
• Requirements Analysis
• Software Development Life Cycle (Sdlc)