Pulastya Das

About Pulastya Das

Data Engineer with 4+ years of experience specializing in Azure Cloud technologies. I have successfully delivered data solutions for industry-leading clients, including a major American pharmaceutical company and a world-leading beverage company in Northwest Europe. My expertise lies in designing, developing, and optimizing scalable data pipelines, real-time data processing solutions, and data warehousing architectures using Azure tools.With a strong foundation in SQL, PySpark, Databricks, Azure Data Factory, Azure Synapse Analytics, Spark Streaming and Python, I am passionate about driving data-driven decision-making through innovative cloud solutions-• Key Skills & Technologies:Azure Data Factory (ADF)Azure DatabricksAzure Synapse AnalyticsApache Spark & Spark StreamingSQL (T-SQL, PL/SQL)PySparkPythonData Warehousing and Business Intelligence (BI)Real-Time Data ProcessingData Lakes & LakehousesPower BIData Modeling & ETL PipelinesAzure DevOps & CI/CDGit Version ControlAPI & Kafka Integration-• Certifications:DP-203: Microsoft Certified : Azure Data Engineer AssociatePL-300: Microsoft Certified : Power BI Data Analyst AssociateDP-900: Microsoft Certified : Azure Data FundamentalsSnowflake SnowPro Core CertifiedFeel free to reach out for collaboration or opportunities in data engineering, cloud solutions, and real-time analytics projects!

Experience

1. Consultant - Data Engineer

   EY

   Dec 2024 — Present · Kolkata, IN

   Proficient in Azure Data Factory, Snowflake, Python, Scala, Oracle Cloud, and Shell Scripting with expertise in ETL pipelines, big data processing, cloud-based data warehousing, and job scheduling using Tidal. Experienced in processing diverse file formats to ensure efficient data ingestion, transformation, and analysis.• Processing complex insurance claims JSON files using Scala. Also Handling other data formats such as Parquet, PDF, and Excel to capture a variety of data sources.• Utilizing Scala and Apache Spark to transform and clean raw data. Storing structured data into Snowflake for efficient querying and analytics.• Designing and optimizing robust ETL pipelines using Azure Data Factory and custom scripts. Automating the data ingestion process to manage high-volume, multi-format datasets.• Leveraging cloud platforms like Oracle Cloud and Snowflake to manage large-scale data warehouses. Ensuring data architecture scalability and performance optimization for business insights.• Integrating Tidal job scheduling tool to automate and orchestrate data workflows. Coordinating complex batch processes and ensuring timely execution of ETL pipelines.• Implementing modern data architectures that support real-time analytics. Enabling data-driven decision-making through efficient data processing and visualization.

Education

• Contai High School

  Pure Science

• Institute of Engineering & Management, Kolkata

  Bachelor of Technology - BTech, Information Technology