Balaji P
Data Engineer @Regions Bank
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Regions Bank
Led the design of Azure Data Factory pipelines to ingest customer, loan, and transaction data into Azure Data Lake Storage.Built Databricks PySpark ETL frameworks processing over 2B records monthly to support risk scoring and credit decisioning.Spearheaded migration of on-premises data warehouses into Azure Synapse, enabling scalable analytics for compliance and audit reporting.Delivered a real-time fraud detection platform using Event Hubs and Stream Analytics, reducing fraudulent approvals by 40%.Defined governance and lineage frameworks with dbt, improving transparency and data quality across compliance datasets.Implemented row-level security and role-based access controls in Synapse and Snowflake to protect sensitive financial data.Optimized Databricks clusters with autoscaling and Delta Lake caching, cutting pipeline runtime by 30% and reducing compute costs. Designed parameterized ADF pipelines to support onboarding of new customer and loan data feeds, reducing development effort and ensuring reusability. Implemented Private Endpoints and Managed Identities for secure connections between ADF, Synapse, and Key Vault, ensuring compliance with banking security policies.
EDUCATION
University of North Texas
3.5
ABOUT BALAJI P
I build and operate data platforms that power large-scale analytics and AI systems and…
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.