Vijayabhaskara R.
Data Engineer | Building Scalable Data Pipelines | Azure | AWS | Spark | Kafka | Lakehouse
- Role
- Data Engineer at Palantir Technologies
- Location
- Beaumont, TX, US
- LinkedIn followers
- 500 followers
Experience
Data Engineer
Aug 2025 — Present · Beaumont, TX, US
Design and build scalable ELT ingestion pipelines on Databricks and AWS S3 using PySpark and Delta Lake, processing structured and unstructured data from 6+ enterprise sources into a governed Medallion architecture serving business analytics and AI teams.Establish data modeling standards and dbt transformation layers on Delta Lake, implementing SCD Type 2 patterns, schema evolution controls, and incremental load strategies adopted across 3 downstream engineering and AI teams.Engineer Apache Airflow DAGs with pipeline observability, SLA monitoring, and automated alerting on AWS, reducing mean time to detect data incidents from 4 hours to under 20 minutes across all production data pipelines.Implement enterprise data governance using Unity Catalog and AWS IAM, enforcing data lineage, role-based access control, and data masking policies while maintaining RAG ingestion pipelines on AWS S3 that process documents.Drive cloud cost optimization across AWS and Databricks by tuning cluster autoscaling, Delta Lake Z-ordering, and PySpark job configurations, reducing monthly compute costs by 25% while sustaining full pipeline throughput.
Education
Manipal University Jaipur
Bachelor's Degree, Computer/Information Technology Administration and Management
Narayana Junior College - India
Intermediate, Mathematics Physics Chemistry
Oxford Public School - Sattenapalli
Matriculation, Mathematics Physics Chemistry
Lamar University
Master of Science - MS, Computer Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.