Ashish Singh

About Ashish Singh

Senior Data Engineer with 13+ years of IT industry experience in BI projects involving AWS Bigdata ecosystem and services like EMR, S3, Athena, SSM, AWS Redshift, Greenplum, Teradata, Oracle, SQL Server, Big Data and NoSQL databases like Cassandra, DynamoDB etc.• Data Engineering experience in DW/DL projects involving Looker, Tableau as reporting solutions and AWS Redshift, S3, Spectrum, Greenplum, Teradata, Oracle, SQL Server as back-end DB, designed complex batch and real time ETL/data pipeline and workflows for processing extremely large data for loading data into the Enterprise Data lake and Data Warehouse to and from multiple database or file systems, structured and unstructured files.• Developed frameworks and reusable components for AWS cloud data migration and Integration.• Responsible for Data Profiling & Analysis, Reverse Engineering, Report and Dashboard design.• Analyze and capture batch, streaming and near real time data Extract, Transform and Load (ETL) requirements for Enterprise Data Lake & Data Warehouse • Built attractive visuals/dashboards to convey the story inside the data using techniques for guided analytics, interactive dashboard design, and visual best practices and expertise in analysis of business requirements for building data marts and data warehouse.• Very good understanding of Data Warehousing and Data Lake Design Methodology, DW Concepts, Database design/architecture including both OLAP & OLTP.• Have been responsible for design and development of multiple applications involving data integration from various Operational Data stores to Enterprise Data Warehouse, Datalake while applying complex business logic and requirements.• Extensive experience in Optimization/Automation of various components ensuring deliverables within the stipulated time to business which enables them to take critical business decisions.• Designed common inventory data model to use single GP code base to load data from different source systems in parallel into Datalake reducing development effort by 90%.• Improved Data load performance and query performance by 70% by implementing optimized data model and query tuning.• Developed generic Data control process to validate data across and at each step of data load reducing the monitoring and post failure RCA effort by 90%.• Developed smartsheet ingestion and Box ingestion models to ingest data directly from smartsheets into Datalake reducing efforts by 90%.• Proficient in Advanced SQL and Analytical queries, Creating Data Pipelines using Python• Professional Scrum Master (I)

Experience

1. Manager, Data Engineering

   Fox Corporation

   Jun 2023 — Present · Los Angeles, CA, US