Priyanka Patel

About Priyanka Patel

Lead ETL Data Engineer & Data Integration Specialist with experience in designing scalable, enterprise-grade data platforms across AWS, Azure, and on-prem environments. Proven track record in building high-performance data lakes, warehouses, and event-driven pipelines that power analytics and business intelligence.Expert in Informatica (PowerCenter, IDMC – CDI/CAI), Snowflake, Matillion, AWS Glue, Step Functions, and metadata-driven ingestion frameworks. Strong focus on Medallion Architecture, data governance, lineage, and quality, leveraging Collibra and Informatica IDQ.Hands-on with Python and R, cloud migrations, ETL orchestration, and BI platforms, including Dremio, SSAS, Business Objects, and MicroStrategy. I enjoy solving complex data problems, modernizing legacy platforms, and enabling organizations to make confident, data-driven decisions.

Experience

1. Lead Etl Engineer and Integration Specialist

   Gainwell Technologies

   Mar 2023 — Present

   Architected an event-driven data pipeline using IDMC CAI, CDI, and ActiveMQ (AMQ) to process real-time event capture and file movement to secure agents.• Designed and implemented scalable ETL architecture leveraging AWS S3 (raw and raw+ locations), optimized in Parquet format for analytics.• Collaborated with architecture, data governance, and risk teams to improve data trust scores and AI readiness of critical datasets• Established a data governance framework using Collibra, ensuring metadata management and lineage tracking.• Integrated MongoDB for operational data storage and Dremio for query acceleration on optimized S3 data.• Led the adoption of AWS Glue, Step Functions, and DynamoDB to orchestrate and monitor ETL workflows.• Developed high-performance PySpark transformations on JSON files, reducing processing time and improving efficiency.• Provided architectural leadership in designing and optimizing end-to-end data solutions, ensuring scalability and performance optimization.