Arun K.
Spark | PySpark | Scala | Databricks-1X Certified | Azure | ADL | ADF | AWS 4X Certified |Talend|Informatica|Tableau|Spotfire|Python|BI
- Role
- Data Engineer Sr Business Systems Analyst at Capgemini
- Location
- Cincinnati, OH, US
- LinkedIn followers
- 500 followers
Experience
Data Engineer Sr Business Systems Analyst
Mar 2020 — Present · Seattle, WA, US
Project: T-Mobile-MARSMigrate On-Premise legacy data from Microsoft SQL Server database into ADW using Azure Database Migration Service.Responsible for implementing standard and best practices for Azure Blob Storage, ADLS, ADW and ADB.Work with platform team to build/manage a Continuous Integration and Continuous Delivery [CI/CD] pipeline using Azure Dev Ops.ETL process, Lift and shift database migration using Azure Data Factory Pipeline from AWS Redshift to Azure SQL Data Warehouse and AWS S3 Bucket to Azure Blob Storage / WHDeveloping Databricks notebooks to process and cleanse source data from Azure Data Lake.Developing Azure Data Factory Pipelines to run Stored Procedures and Databricks Notebooks.Experience in Azure technologies -Data Lake to move data from multiple source systems.Azure DataBricks to analyze data using Spark and Scala and Data Factory to run the pipelines to load data.
Education
Symbiosis Centre for Distance Learning
PGDBM
2011 — 2013
The University of Texas at Austin
POST GRADUATE PROGRAM IN ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING: BUSINESS APPLICATIONS
2024 — 2024
Berhampur University
Mechanical
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.