B. Manoj
Immediate Joiner| 3.8 Yrs |Data Engineer | Expert in PySpark, Spark SQL & Azure Data Factory |Palantir Foundary| Skilled in Scalable ETL Pipelines, Airflow Orchestration & Data Governance | Insurance Domain Specialist .
- Role
- Data Engineer at Tata Consultancy Services
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About B. Manoj
I am a Data Engineer with 4 years of experience building scalable batch and streaming…
Experience
Data Engineer
Jan 2023 — Present · Bengaluru, IN
Description:Led the end-to-end design, development, and optimization of scalable data pipelines and semantic layers for Life & Health reinsurance data using Palantir Foundry, supporting regulatory, actuarial, and business reporting use cases.Key Contributions:Built modular, scalable ETL pipelines using PySpark, SQL, and Foundry Code Repositories for seamless migration from Oracle DW to AWS-backed architecture.Integrated AWS services (Glue, S3, Lambda) to create cost-efficient, event-driven data workflows.Applied Spark optimizations (broadcast joins, partitioning, skew handling) to enhance job performance by 40%.Implemented @transform and @incremental pipelines to support efficient, repeatable batch processing.Developed robust data validation and QA checks using Contour and dynamic preview modules for real-time output validation.Created semantic Ontologies in Foundry to support metadata governance, data lineage, and self-service analytics.Delivered curated, production-grade datasets across raw, intermediate, and curated layers for consistent business consumption.Built real-time dashboards using Power BI, Fusion Sheets, and Palantir Workbooks to visualize KPIs and support decision-making.Automated transformation logic via Palantir AIP, reducing manual coding and enabling low-code enhancements.Managed CI/CD and promotion workflows across DEV → MASTER environments using Azure DevOps (Stargate).Collaborated with cross-functional teams (Actuarial, Pricing, PM, TA) to align data design with financial models (EVM, BEL) and reporting standards (IFRS, PMG).Mentored junior engineers on semantic modeling, pipeline optimization, and Foundry best practices.
Education
Narayana Junior College - India
Intermediate (12th), Mpc
KSRM COLLEGE OF ENGINEERING
Bachelor of Technology - BTech, ece
2017 — 2021
Oxford English medium high school
SSC
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.