Walsh S
Data Engineer (App Development Associate) @Accenture
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer (App Development Associate) @Accenture
Bengaluru, IN
Designed, built, and maintained scalable ETL/ELT data pipelines using Python, SQL, PySpark, Azure Databricks, and dbt, supporting analytics and reporting use cases. Automated data extraction, transformation, and validation workflows, reducing data handling by 40% and improving reliability.• Analyzed execution plans and optimized complex SQL queries, improving query performance and system response times for large-volume datasets. Translated business requirements into logical and physical data models, enabling high-performance analytics and downstream BI consumption.• Implemented data quality checks, validation rules, and error-handling mechanisms to ensure production-grade data accuracy.• Established coding standards for data scripts and stored procedures; conducted peer code reviews to ensure defect-free deployments.• Collaborated with cross-functional stakeholders to deliver backend data services and integrations using Spark-based frameworks. Supported production data systems, incident resolution, SLA adherence, and continuous improvement in Agile/Scrum delivery models.• Managed delivery tracking, capacity planning, and stakeholder for client-facing data initiatives.• Establish CI/CD pipelines with GitHub Actions and Azure DevOps, implementing automated testing and monitoring with integrated alerting
EDUCATION
Bishop Heber College
Bachelor's degree
Vellore Institute of Technology
Postgraduate Degree
ABOUT WALSH S
Data Engineer with 2+ years of hands-on experience building production-grade data pipelines and analytics solutions for enterprise clients. I specialise in designing scalable ETL/ELT architectures using Azure Databricks, Spark, Python, and modern data engineering tools.What I Do:I translate complex business requirements into reliable, high-performance data systems. My work focuses on building end-to-end data pipelines that process large-scale datasets, enabling analytics teams and stakeholders to make data-driven decisions with confidence.Technical Expertise- Data Pipeline Engineering: Designing and deploying production ETL/ELT workflows using PySpark, Azure Databricks, Delta Lake, and dbt- Data Modeling & Architecture: Implementing dimensional models (star schema, SCD Type 2) and medallion architecture (bronze/silver/gold layers)- Performance Optimization: Analyzing query execution plans, applying partition strategies, and tuning Spark jobs for efficiency- Data Quality & Governance: Building automated testing frameworks using dbt tests, data validation rules, and monitoring systems- Cloud Platforms: Azure (Databricks, Data Lake Gen2, Data Factory), AWS (S3, Redshift, Glue), Snowflake- Orchestration & Automation: Apache Airflow DAGs, CI/CD pipelines with GitHub Actions and Azure DevOpsWhat Sets Me Apart:I combine strong analytical thinking from my mathematics background with practical engineering skills. I\'m passionate about writing clean, maintainable code and building data systems that are both performant and reliable. I thrive in collaborative environments, working closely with analysts, BI developers, and business stakeholders throughout the project lifecycle.My approach focuses on: Delivering data solutions that meet business needs, not just technical requirements Maintaining production systems with high reliability and data quality standards Continuously learning and applying best practices in data engineering Clear communication and documentation to ensure knowledge transferProfessional Background:Currently working at Accenture as a Data Engineer, where I design and maintain data pipelines processing substantial daily volumes across multiple client projects. I\'ve worked on initiatives spanning retail analytics, financial reporting, and operational dashboards, always ensuring data accuracy and system performance.Let\'s connect if you\'re looking for a data engineer who can deliver reliable, scalable data solutions for your organization.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.