Amarnath Palani

Certified Azure Data Engineer | Databricks | pyspark | ETL Developer | SQL | .NET Developer

Role
Data Engineer at Tata Consultancy Services
Location
Vellore, TN, IN
LinkedIn followers
500 followers
Information TechnologyView LinkedIn profile

About Amarnath Palani

Certified Azure Data Engineer | Databricks | PySpark | ETL Developer

Experience

  1. Data Engineer

    Tata Consultancy Services

    Apr 2024 — Present · Chennai, IN

    Migrated legacy C# batch jobs for shipment validation & rating into scalable ADF & Databricks (PySpark) pipelines, reducing dependency on monolithic systems.Designed ETL pipelines to ingest shipment, customer, and rate master data from SFTP, APIs, flat files, RDBMS, integrating rating reference data for accurate validation.Implemented business validation rules (weight/dimensions, address, service eligibility, duplicates, mandatory fields) and optimized pipelines using partitioning, caching, and broadcast joins.Collaborated with SMEs, business stakeholders, and C# API developers to ensure SLA adherence, smooth integration, and accurate shipment rating.

Education

  • Ganadipathy Thulis' Jain Engineer College

    B.E: Computer Science And Engineering

  • Sri Venkateswara Polytechnic College - India

    Diploma of Education

  • Government Muslim Higher Secondary School, Vellore

    SSLC

Find verified contacts for anyone on LinkedIn

Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.

Free plan included · No credit card required

This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.

Amarnath Palani — Data Engineer at Tata Consultancy Services in Vellore, TN, IN | Unifers