Kolipaka Sathish
Data Engineer (Azure Databricks |ADF |PySpark |Python | SQL| ETLpipeline | sqoop |spark |Hadoop | BERT AI-PII tool (95% accuracy) | Hyderabad
- Role
- Big Data Engineer at Tata Consultancy Services
- Location
- Hyderabad, TG, IN
- LinkedIn followers
- 500 followers
About Kolipaka Sathish
Data Engineer specializing in Azure Databricks, PySpark & Hadoop ETL pipelines | TCS/MetLife | 4+ Yrs | Hyderabad TECHNICAL EXPERTISE:• Azure Data Factory → PySpark orchestration (50% runtime reduction)• Synapse → Databricks migration (3x performance improvement)• mdfe_batch_processor delivery (95% error reduction) HIGHLIGHTS:• BERT AI-PII Scanner (95% accuracy)- MetLife enterprise tool• IBM Optim → PySpark migration (89 apps, 60% faster)• Automated PII detection in Hadoop ETL (70% manual effort saved) STACK: PySpark | Azure Databricks | ADF | Hadoop | Delta Lake | Spark SQL | Python | SQL | Data Masking Open to Senior Data Engineer roles | Hyderabad/Remote | Let\'s connect!#AzureDatabricks #PySpark #DataEngineering #BigData #ETL
Experience
Big Data Engineer
Oct 2021 — Present
Data Engineer | Azure Databricks | PySpark | Hadoop | TCS/MetLife (4+ yrs) ETL Pipeline Specialist:• Orchestrated ADF→PySpark pipelines cutting runtime 50% • Delivered mdfe_batch_processor (95% error reduction)• Synapse→Databricks migration (3x performance boost) Key Achievements:• BERT AI-PII Scanner: Built 95% accuracy tool → MetLife enterprise solution• Led IBM Optim→PySpark migration for 89 apps (60% faster)• Automated PII scanning across Hadoop ETL (70% manual effort saved) Tech Stack: PySpark | Azure Databricks | ADF | Hadoop | Delta Lake | Spark SQL | Python | SQL | Data Masking | Azure SQL Hyderabad | Open to opportunities | DM for collaborations#DataEngineering #PySpark #AzureDatabricks #BigData #ETL
Education
Jawaharlal Nehru Technological University Hyderabad Jntuh
Master of Technology, Computer Science
2019 — 2021
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.