Mukesh Singh
DE Specialist/Manager at The Smart Cube
- Role
- Data Engineering - Specialist Manager at The Smart Cube
- Location
- Ghaziabad, IN
- LinkedIn followers
- 500 followers
About Mukesh Singh
With over 16 years of experience in the data engineering stack on a variety of cloud and on-premise systems. I have delivered over ten complete enterprise solutions for business users, data analytics, data science, and data visualization teams, including legacy systems, cloud-based technologies and tools, data lakes, as well as data warehouses, by streamlining data pipelines, building data warehouses, BI reports, and dashboards. Database/data warehouse architectural design, consulting, assessment, direction, guidance, and training on Business Intelligence, Data Warehousing, and Azure SQL Server, with a focus on the Microsoft BI stack and specialists in the continue developing below- Google Cloud Platform: Google BigQuery to build data components (database/data warehouse), Google Compute Engine by using Python/PySpark in Notebook, Google Data Storage for handling files, Dataflow, DataProc /Data Fusion to build up ETL processes, and Cloud Function/Cloud Scheduler to automate the Compute Engine data pipeline process by using Cloud Composer. AWS Platform: Amazon SageMaker to convert business aspects to functional aspects; Amazon S3 bucket to load multiple files; Amazon Redshift to build data components (database/data warehouse); and Lambda functions, EMR, EC2, Cloud Watch, and Amazon Event Bridge to automate the Amazon SageMaker data pipeline process. Azure Platform: Azure DataBricks, Azure Data Factory to build ETLs, Azure Data Lake Gen 2 to store data files, Azure SQL Server to build databases and data warehouses, Azure Functions, Time Trigger, and Azure Synapse Analytics. Write complex Python and PySpark codes in Azure DataBricks, GCP Vertex VI and AWS DataBricks. Data migration from AWS S3, Redshift, Salesforce, SharePoint, Confluent Kafka Streaming data, SFMC, Salesforce and APIs to GCP BigQuery/Cloud storage or vice-versa. Social Media (Twitter, Reddit, Facebook, YouTube, Instagram) expert, YouTuber and Blogger on various technologies
Experience
Data Engineering - Specialist Manager
Jun 2020 — Present · Noida, IN
Google Cloud Platform* – Google BigQuery to build data components (database/data warehouse), Google Compute Engine by using Python/PySpark in Notebook, Google Data Storage of handling files, Data Proc/Data Fusion to build up ETLs processes and Cloud Function/Cloud Scheduler to automate the Compute Engine data pipeline process AWS Platform –Amazon SageMaker to convert business aspect to functional aspect, Amazon S3 bucket to load multiple files and Amazon Redshift to build data components (database/data warehouse) and Lambda function, Cloud Watch, Amazon EventBridge to automate the Amazon SageMaker data pipeline process Azure Platform – Data Bricks, Azure Data Factory to build ETLs, Azure Data Lake Gen 2 to store structured, semi structured data files, Azure SQL Server to build data components (database/data warehouse), Azure Synapse Analytics, Write complex Python and PySpark codes in Azure DataBricks and AWS DataBricks.
Education
Choudhary Charan Singh University, Meerut
B.Sc -PCB, Science
1999 — 2002
University of Allahabad
X, PCM
1991 — 1997
University of Allahabad
XII, Physics
1998 — 1999
Punjab Technical University
M.Sc.(IT), Information Technology
2003 — 2004
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.