Jose S Chaviel
Data Engineer at Centene Corporation
- Role
- Sr Data Engineer at Centene Corporation
- Location
- Houston, TX, US
- LinkedIn followers
- 500 followers
About Jose S Chaviel
Highly motivated Sr. Data Engineer with 10+ years of experience in Data Engineering, Data Warehousing, ETL, and Cloud Technologies. Expertise in SQL, Azure Data Factory (ADF), MS Fabric, AWS, Snowflake, Databricks, Python, and DevOps. Skilled in data migration, governance, modeling, and BI reporting with a proven track record in optimizing and automating data pipelines.
Experience
Sr Data Engineer
Oct 2023 — Present
Played key role in the Snowflake EDH migration, ensuring improved scalability and data processing.• Developed and maintained data pipelines within Snowflake and SQL-based databases, ensuring optimal data ingestion and transformation.• Designed and deployed an automated ServiceNow to Snowflake data pipeline using Python, GitLab CI/CD, and Rancher for containerized deployment.• Created materialized views and access views in Snowflake for optimized querying and access control of transformed data• Ensured data integrity and performance tuning by optimizing Snowflake stream processing, task scheduling, and JSON flattening logic• Built and modularized PySpark DataFrame-based pipelines in Databricks, managing structured and semi-structured data from APIs and blob storage into Delta Lake for downstream analytics• Designed and deployed scalable Databricks pipelines to ingest, index, and transform CCDA and PDF-based clinical documents• Utilized PySpark and Delta Live Tables to implement high-throughput transformations with schema enforcement, ACID compliance, and time travel features• Integrated Power BI reporting solutions, working closely with BI engineers to streamline data visualization and minimize front-end data manipulation.• Implemented GitLab CI/CD pipelines for version control, automated deployments, and performance monitoring.• Collaborated in a shared accountability model, ensuring data solutions aligned with business goals and team objectives.• Developed and executed weekly queries in Teradata to extract legacy data and load results into Snowflake for downstream reporting and analytics• Maintained and updated technical documentation in Confluence to reflect changes in data models, ETL pipelines, and business logic• Provided data governance oversight, ensuring data quality, consistency, and compliance with healthcare industry standards
Education
Universidad Rafael Belloso Chacín
Bachelor's degree, Computer Engineering
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.