Stephen I.
Data Engineer @Two Sigma
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Two Sigma
Designed and implemented multiple Python-based ETL pipelines to ingest and normalize multi-source institutional financial data from email attachments, processing 160+ files daily.• Leveraged PyArrow and Pandas to handle heterogeneous CSV/XLS/XLSX inputs, implementing intelligent schema mapping to unify 50+ distinct fund allocation formats across 15+ providers.• Engineered data quality and validation layers with type-safe schema enforcement, accounting notation handling, and automated detection of test data.• Built a flexible schema detection system using column pattern matching and dynamic header recognition to standardize vendor-specific naming conventions for downstream portfolio analytics.• Developed a Python-based REST API data crawler to integrate third-party financial market data, using Azure AD (MSAL) and certificate-based authentication for secure, automated daily ingestion.• Architected support for T+1 data delivery schedules and multi-format ingestion (CSV/JSON) with resilient error handling and monitoring for non-announcement days.• Conducted root-cause investigations into data pipeline failures, tracing data lineage across 20+ transformation stages to identify and correct data contamination, format mismatches, and extraction errors.• Collaborated with analysts and ML teams to debug hybrid human-machine workflows, reducing false positives in document validation and improving reliability of financial document extraction pipelines.
EDUCATION
Western University
Bachelor of Applied Science - BASc, Computer Software Engineering
ABOUT STEPHEN I.
Software Engineer with expertise in developing scalable back-end systems, building user-friendly web applications, and optimizing performance. Proficient in JavaScript frameworks (React, Angular, Node.js), Python, and C#. Skilled in creating and optimizing RESTful APIs and working with database technologies like MongoDB and MySQL.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.