Parthiban Pragalathan
Data Engineer | PySpark | Python | SQL | ETL Pipelines | Airflow | AWS | ETL Automation | Big Data | Financial Data | 4+ Years
- Role
- Senior Software Developer at Factentry
- Location
- Vellore, TN, IN
- LinkedIn followers
- 500 followers
Experience
Senior Software Developer
Jan 2022 — Present · Vellore, IN
I’m a Python Data Engineer with 4+ years of experience building and operating production-grade data pipelines in financial and pricing domains.My background started in Python development, and over the last few years I’ve transitioned fully into Data Engineering — working hands-on with Apache Spark, SQL, AWS, and Apache Airflow to design scalable ETL systems. What I do:• Build batch ETL pipelines using PySpark (joins, aggregations, partitioning, broadcast joins)• Design raw → processed → curated data lake architectures on AWS S3• Develop Airflow DAGs with retries, backfills, alerting, and failure recovery• Implement incremental & idempotent pipelines with data quality checks• Optimize Spark + SQL workloads (30–40% performance improvement)• Process financial market & bond pricing data across 16+ currencies• Deliver SLA-driven datasets to enterprise systemsI’ve worked extensively with Python, PySpark, SQL Server, AWS (S3/EC2), Linux, REST APIs, and Git — owning pipelines end-to-end from ingestion to client delivery.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.