Vishal Agrawal

WORK HISTORY

EDUCATION

ABOUT VISHAL AGRAWAL

As a passionate and experienced Data Engineer with 6+ years in the industry, I specialize in designing and implementing robust data solutions in the cloud, particularly using Azure Cloud services. My experience spans various domains, including Finance, Retail/CPG, Asset Management (Shipping/Containers), and Terminal Management, where I have successfully managed and optimized data infrastructures to drive business insights and efficiency.I bring a strong proficiency in distributed processing technologies such as Apache Kafka,Apache Spark, Spark SQL, and PySpark, coupled with extensive programming skills in Python and basic Scala. My expertise also includes working with data storage and processing tools like HDFS and MS SQL Server, as well as advanced analytics using AAS/Cubes and Power BI for dashboarding.In addition to my technical skills, I am adept at both functional and object-oriented programming paradigms and have a solid foundation in data modelling and change data capture. I have designed and maintained data pipelines using Azure Data Factory and developed streaming applications with Spark Streaming.My cloud services experience includes working extensively with Azure Databricks, Azure DevOps, Azure Logic Apps, Azure Data Lake Storage, Azure Blob Storage, Azure Data Warehouse, and Azure Analysis Services. In the realm of data science, I excel in exploratory data analysis (EDA), feature engineering, and modelling, ensuring that data-driven decisions are both accurate and impactful.As a self-starter, I thrive in collaborative environments, working closely with data scientists and software engineers to design, test, and build production-ready machine learning models and distributed algorithms on large-scale data sets. My goal is to leverage my skills to create innovative data solutions that enhance operational efficiency and deliver actionable insights.