Serap Aydogdu Malone
Senior Data Engineer @GoodRx
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @GoodRx
San Francisco, CA, US
Developing and optimizing large-scale data pipelines processing ~180M records/daily (over 2 billion pricing and claims data per week) using Apache Spark on Databricks. • Migration over 100 billion+ pricing and claims data to a modern Lakehouse architecture with Databricks and Delta Lake, introducing ACID transactions, schema enforcement, and improved governance for scalable data management.• Creating and maintaining complex ELT processes written in PySpark and SQL scripts to process and analyze multi-terabyte datasets in a Data Lakehouse.• Designing data models by leveraging Medallion architecture in big data to track changes across billions of records, storing both historical and current data to support BI and AI products. • Using CI/CD and CodeFresh for project management.• Using Aiflow to automate, schedule and monitor data pipelines.• Utilizing AWS S3 storage, Redshift, Docker, Kinesis to scale for large datasets effectively. •
EDUCATION
Suleyman Demirel University
Bachelor of Engineering - BE, Computer Engineering
Istanbul Technical University
Master of Science - MS, Big Data and Business Analytics
ABOUT SERAP AYDOGDU MALONE
9+ years of experience in Data Engineering with a Master’s in Big Data and Business Analytics. Certified in Big Data technologies such as Databricks and Snowflake.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.