Ashwin U.

Data Engineer @Walmart

NJ, US

Crafted cutting-edge data warehouses using Hadoop, Snowflake, and Hive, ensuring a seamless blend of efficiency and capacity for vast data volumes- Orchestrated ETL processes with PySpark, Kafka, and Spark Streaming, transforming disparate data sources into unified streams of insight- Led cross-functional teams to define data needs and build robust data structures, ensuring the integrity and accessibility of information- Leveraged cloud platforms such as AWS, Azure, and GCP to… Show more - Crafted cutting-edge data warehouses using Hadoop, Snowflake, and Hive, ensuring a seamless blend of efficiency and capacity for vast data volumes- Orchestrated ETL processes with PySpark, Kafka, and Spark Streaming, transforming disparate data sources into unified streams of insight- Led cross-functional teams to define data needs and build robust data structures, ensuring the integrity and accessibility of information- Leveraged cloud platforms such as AWS, Azure, and GCP to create secure and scalable data storage and processing environments- Utilized SQL, Python (Pandas, NumPy), and Spark MLlib to analyze data and develop machine learning models, uncovering hidden insights and opportunities- Implemented real-time analytics with Spark Streaming and Kafka, enabling instantaneous insights from streaming data sources- Ensured data quality and consistency across all data pipelines and storage systems, maintaining the trustworthiness of data assets- Collaborated with Data Scientists to integrate machine learning models into the data ecosystem, enhancing decision-making processes- Developed web applications using Next.js, Node.js, and React, providing interactive and user-friendly interfaces for data exploration- Worked closely with Data Analysts to refine data workflows, ensuring efficient and effective data transformation and analysis- Orchestrated ETL workflows using Apache Airflow, managing dependencies and scheduling to ensure smooth data processing operations- Navigated the complexities of the Hadoop ecosystem, Spark, Kafka, Snowflake, and cloud platforms, leveraging their capabilities for optimal data management- Engaged in continuous learning and industry research to stay ahead of the curve in data engineering trends and technologies.

Montclair State University

Master's degree, Data Science

Douglas College

Post Degree Diploma, Data Analytics

Victoria University

Bachelor's degree, Information Technology