Akshay Master

About Akshay Master

I’m a Senior Data Engineer with over 6+ years of experience building scalable, cloud-based data solutions. My work spans end-to-end data pipelines, real-time streaming systems, and cloud data platforms, primarily using AWS, Python, and Spark.I’ve delivered impactful solutions at companies like Allstate, Albertsons, and Max Healthcare, where I designed and deployed ETL/ELT workflows using tools like AWS Glue, Airflow, and Talend. My focus has been on creating highly reliable, automated, and cost-efficient data processes across both batch and real-time environments.My expertise includes big data tools (Spark, Kafka, Flink), data warehouses (Redshift, Snowflake), and NoSQL systems (MongoDB, Cassandra, DynamoDB). I’m also skilled in data visualization using Power BI and Tableau, helping teams turn raw data into actionable insights.I enjoy working on challenging data problems, optimizing cloud infrastructure, and enabling faster decision-making through well-architected data systems. I’m always open to discussing cloud data engineering, real-time analytics, and modern data stack design.

Experience

1. Senior Data Engineer

   Allstate

   Mar 2024 — Present · Northbrook, IL, US

   At Allstate, I work as a Senior Data Engineer, leading the design and implementation of scalable data pipelines on AWS. My primary focus is on building end-to-end ETL workflows using AWS Glue, Athena, and PySpark to transform large datasets for analytics, reporting, and operational insights.I’ve developed automated data ingestion pipelines that move data across AWS services like S3, Redshift, RDS, and DynamoDB. These pipelines are orchestrated using Apache Airflow and monitored via CloudWatch to ensure reliability and consistency across systems.In addition to batch processing, I build real-time data streaming solutions using Kafka, Spark Streaming, and Flink—enabling near real-time analytics that support rapid business decision-making. I also use Python and Scala extensively to script custom data transformations and feature engineering tasks.My role involves optimizing data warehouse performance, particularly in Snowflake and Redshift, ensuring cost-effective and high-performance querying. I also create data models in NoSQL databases like MongoDB and Cassandra to support fast, scalable access to transactional data.Beyond engineering, I contribute to data visualization efforts by developing Power BI dashboards that deliver clear, actionable insights. I follow DevOps practices for CI/CD, use Git for version control, and collaborate closely with cross-functional teams in an Agile environment using JIRA.

Education

• Jawaharlal Nehru Technological University Hyderabad (JNTUH)

  Bachelor of Technology - BTech, Computer Science