Sourav Sarkar

About Sourav Sarkar

Hi, I’m a Data Integration and ETL specialist with over 11 years of experience…

Experience

1. Data Consultant

   MSH

   Oct 2022 — Present · IN

   My role in this organization is designing, building, and maintaining the data infrastructure and systems that enable our enterprise to effectively leverage the data assets for insights, decision-making, and innovation. In order to do this it is required to collaborate with stakeholders, including data scientists, analysts, and business users, to understand their data requirements, use cases, and expected outcomes.Also, we define the scope and objectives of the data pipeline, including the types of data to be ingested, processed, and analyzed, as well as the frequency and volume of data.At the same time we identify and catalog the sources of data that need to be integrated into the pipeline, including databases, data warehouses, APIs, files, and external sources(if any).In addition to that, we optimize the performance of the data pipeline by fine-tuning data processing tasks, optimizing SQL queries, and parallelizing data processing operations to leverage distributed computing resources effectively.Handling these roles involve a combination of technical skills, domain knowledge, analytical problem solving abilities, and collaboration with cross-functional teams to deliver scalable, reliable, and performant data engineering solutions. We use Google Big Query as our DWH tool and IICS as ETL tool. Python is also used as per requirement and we use different applications of GCP as and when required.Also, I contribute to the hiring pipeline actively by evaluating candidates on the technical areas.

Education

• West Bengal University of Technology, Kolkata

  Bachelor of Technology - BTech

  2010 — 2014