Arvind Reddy Narra
Data Engineer @Cavallo Technologies Inc.
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Cavallo Technologies Inc.
Ottawa, ON, CA
Contributing to a cloud-based Lakehouse platform using Databricks, PySpark, Delta Lake, and Delta Live Tables (DLT)/ declarative pipeline patterns for batch and streaming-oriented data processing- Worked with Databricks Asset Bundles (DABs) and GitHub Actions to support multi-environment (dev / preview / prod) CI/CD deployment workflows for Databricks Jobs and DLT pipelines, including environment-specific configuration and deployment validation- Helped standardize and maintain the CI/CD process by reviewing deployment configurations, monitoring workflow runs, troubleshooting failures, and improving reliability of release promotion across environments- Supported migration of deployment workflows from manual/legacy patterns to DABs + GitHub Actions, improving repeatability, reducing configuration drift, and aligning delivery to team standards.Implementing SCD Type 2 logic, incremental loads, and schema enforcement to ensure historical accuracy and consistency across datasets- Developing reconciliation and identifier-matching logic to unify overlapping datasets from different vendors into consistent reference views (canonicalized business views)- Implementing data quality checks, validation logic, and automated pipeline guardrails within DLT to detect anomalies, enforce business rules, and improve release confidence- Working with Structured Streaming / streaming ingestion patterns (where applicable) and ensuring checkpointing, schema handling, and production-safe operational behavior- Supporting logging, alerting, and monitoring for pipeline operations and deployments to improve incident detection, troubleshooting speed, and production visibility- Contributed to SAS-to-Databricks migration efforts by translating transformation logic into PySpark, and implementing automated validation checks (e.g, row counts, schema checks, key-level reconciliation, and aggregate comparisons) to verify parity between legacy and modernized outputs.
EDUCATION
Carleton University
Master's degree, Computer Software Engineering
VNR Vignana Jyothi Institute of Engineering and Technology (VNRVJIET)
Bachelor of Technology - BTech, Electrical and Electronics Engineering
ABOUT ARVIND REDDY NARRA
I\'m a results-focused Azure Data Engineer with experience in designing and deploying scalable data pipelines across cloud-native environments. My expertise lies in building real-time and batch data solutions using Azure Data Factory, Databricks, Synapse Analytics, and Apache Spark, delivering measurable impact across finance, compliance, and healthcare analytics.I’ve led the end-to-end development of ETL/ELT frameworks that reduced data latency by up to 40%, streamlined reporting cycles, and enabled faster decision-making through Power BI and SQL-based modeling. I\'m hands-on with CI/CD automation (Azure DevOps, Terraform) and have strong foundations in data governance, role-based access control, and Azure Key Vault.Currently expanding my expertise in Databricks and Microsoft Fabric, focusing on unified lakehouse architectures and integrated BI solutions.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.