Pallabi Das

About Pallabi Das

I\'m an experienced Data Engineer with a strong background in Big Data technologies and cloud platforms. I have extensive expertise in Apache Hadoop, Spark, Kafka, AWS, GCP, and various components of the Hadoop ecosystem. I have successfully implemented and managed Big Data projects, working on ingestion, processing, and analysis of data from diverse sources. My skills include data modeling, data pipeline development, real-time data streaming, and performance tuning. I\'m proficient in Java, Scala, Python, Shell scripting, and SQL/PL-SQL. My ability to set up and manage Hadoop clusters on cloud platforms and her strong problem-solving and communication skills make her a valuable asset for data engineering and analytics initiatives.

Experience

1. Gcp Data Engineer

   Walmart

   May 2023 — Present · Dallas, TX, US

   Designed the incremental data push project to have more control over logging and performance and suggested best redesign that paved a way for profitability to business.• Obtained the business requirements and communicated to offshore team by daily meetings for designing and developing as per the requirement like gathering/coding/QA/implementation process.• Involved in writing business complex logics using SQL/Spark SQL techniques like bulk collect, types, string handling procedures, functions, as catalog project deals with item flows among various systems keen understanding of the existing system need to consider as the changes to any item attribute it will impact the business in multiple ways.• Responsible for analysis and co-ordination between various teams at Walmart information systems.• Used BigQuery to ingest data from various sources into its tables• Hands on experience in Creating procedures to generate reports to front end like power BI.• Created complex views, used grouping techniques to filter out bundles which have visual variant, mandatory items, with visible display status, having items related to Walmart etc. achieved the business logic using complex SQL written.

Education

• Chicago State University

  Master's degree