Amarnath Palani
Certified Azure Data Engineer | Databricks | pyspark | ETL Developer | SQL | .NET Developer
- Role
- Data Engineer at Tata Consultancy Services
- Location
- Vellore, TN, IN
- LinkedIn followers
- 500 followers
About Amarnath Palani
Certified Azure Data Engineer | Databricks | PySpark | ETL Developer
Experience
Data Engineer
Apr 2024 — Present · Chennai, IN
Migrated legacy C# batch jobs for shipment validation & rating into scalable ADF & Databricks (PySpark) pipelines, reducing dependency on monolithic systems.Designed ETL pipelines to ingest shipment, customer, and rate master data from SFTP, APIs, flat files, RDBMS, integrating rating reference data for accurate validation.Implemented business validation rules (weight/dimensions, address, service eligibility, duplicates, mandatory fields) and optimized pipelines using partitioning, caching, and broadcast joins.Collaborated with SMEs, business stakeholders, and C# API developers to ensure SLA adherence, smooth integration, and accurate shipment rating.
Education
Ganadipathy Thulis' Jain Engineer College
B.E: Computer Science And Engineering
Sri Venkateswara Polytechnic College - India
Diploma of Education
Government Muslim Higher Secondary School, Vellore
SSLC
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.