Ashil Shah
Data Engineer - Azure | AWS | Databricks | Python | Data Warehouse | SQL | ELT | DevOps | IaC
- Role
- Data Engineer at Itmiracle
- Location
- Dallas-Fort Worth, TX, US
- LinkedIn followers
- 500 followers
About Ashil Shah
Data Engineer with 8 years of hands-on experience in designing, developing, and maintaining robust data products and pipelines. Specializing in domains such as Finance/Banking, Insurance, and Retail, with a track record of successful collaborations across 5 clients. Proven ability to drive efficiency gains, innovate platforms, and ensure data accuracy to meet evolving business demands. Databases: Azure SQL, AWS Redshift, Microsoft SQL Server, MySQL, PostgreSQL & Oracle Big Data: Databricks, Snowflake, Spark Programming: Python, Scala, SQL, Kusto Query Language, Shell script Cloud: Azure (Azure Databricks, Azure SQL, Azure Data Factory, Azure Synapse, Azure Data Lake Storage, Azure Blob Storage, Azure Event Hubs, Azure Cosmos DB), AWS (AWS Glue, AWS S3, AWS Lambda, AWS Redshift, AWS EMR, AWS Cloud Watch, AWS Athena) ETL: ADF, AWS Glue, SSIS, Airflow (Orchestration) BI: Tableau, PowerBI, SSRS DevOps: CI/CD, Azure DevOps, Git, Terraform, Tortoise SVN Other: Kafka, Visio, Visual Studio Code, Lucid, Miro
Experience
Data Engineer
Aug 2024 — Present · Los Angeles, CA, US
Built a reusable, parameterized data ingestion pipeline in Azure Data Factory to transfer on-prem data to Azure Cloud, with metadata-driven configs, logging and robust error handling.Developed end-to-end data pipelines in Databricks using Medallion Architecture to ingest high volume data from On-prem database, Azure SQL, files in batch and streaming implementing design best practices.Implemented scalable data lake, data pipeline utilizing PySpark and reporting solutions using serverless compute with best practices.Implemented CI/CD pipelines in Azure DevOps for ADF and Databricks (Databricks Asset Bundles), automating deployments and testing, which reduced release times by 70% and minimized production errors.Secured Azure subscription wide access and control using Azure RBAC on Azure Databricks, Azure Storage, Azure Key Vault, ADF and Azure SQL.Assisted in Infrastructure automation using Terraform and Azure DevOps.
Education
VIT_Vellore Institute of Technology
Master of Technology - MTech
2015 — 2019
Xavier institue of computer application
Bachelor's of Computer Application
2012 — 2015
California State University, Fullerton
Master's degree
2022 — 2024
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.