Arvind Shrivastava
Associate Principal - Data Engineer @LTIMindtree
Signup · Get unlimited contacts
WORK HISTORY
Associate Principal - Data Engineer @LTIMindtree
London, GB
For Booking.com,* Led a successful migration team for Hadoop workflows to Snowflake using dbt models and Airflow, achieving <1% data variance.* Migrated on-prem Hadoop systems to AWS, designing scalable data pipelines, models, and marts for accommodation, customer, and partner onboarding teams, leveraging CI/CD workflows in GitHub.* Built cloud-native AWS environments using Terraform to provision Development, Integration, and Production setups, enabling terabyte-scale data processing while enhancing performance, automation, and scalability.* Developed reusable dbt macros for data validation and transformation, reducing development time by 20%. Built optimized SQL scripts with advanced aggregations, window functions, and joins to efficiently process large datasets.* Ingested OpenSearch logs from Kafka to S3, transformed data with Glue, monitored pipelines via CloudWatch, and created DataMart using Athena, enhancing data accessibility and decision-making.* Developed a serverless ETL pipeline using AWS Lambda to ingest critical API logs from OpenSearch into Jupyter Notebook, enabling advanced log analysis with Python.* Developed a test utility that reduced testing effort and time by 80%, enabling versatile sample data generation for various scenarios. Optimized Spark and SQL code to boost performance.* Designed data marts and golden standard tables for VCC & BT use cases, enabling business analysts to write simple queries for faster analysis and visualization, saving time and effort.* Delivered projects using Agile methodologies.* Achieved 99% uptime for critical workflows and supported monitoring and execution of key KPIs and dashboards.* Documented requirements and solutions with flow diagrams using Confluence and diagrams.net.* Collaborated with cross-functional teams, demonstrating strong communication, influence, and negotiation skills with stakeholders.* Spearheaded the mentorship and training of 4 junior team members.
EDUCATION
Lakshmi Narain College of Technology, Kalchuri Nagar, Raisen Road, Post Klua, Bhopal-462021
Electrical and Electronics Engg., Elelctrical and Electronics Engg.
SKILLS
ABOUT ARVIND SHRIVASTAVA
I am an Associate Principal Data Engineer with 15+ years of experience architecting and delivering cloud-native data platforms across AWS, Azure, and Snowflake. My expertise spans Databricks, dbt, Airflow, Kafka, and Terraform, with proven success in building scalable ETL/ELT pipelines, data meshes, and regulatory-compliant platforms.I have led large-scale transformations, including enterprise Snowflake adoption, Hadoop-to-Snowflake migrations, and CI/CD-driven automation, consistently delivering 99%+ pipeline uptime and reducing costs by up to 30%.I thrive at the intersection of data engineering and leadership — mentoring high-performing teams, driving architectural standards, and partnering with stakeholders to align data initiatives with strategic business goals. Passionate about enabling real-time analytics and ML model deployment, I specialize in building data platforms that unlock actionable insights and long-term business value.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.