David Donnelly
- Role
- Senior Data Engineer at IBM
- Location
- New York, NY, US
- LinkedIn followers
- 500 followers
Experience
Senior Data Engineer
Aug 2021 — Present
Build data pipelines to integrate applications using reverse ETL, distributed ETL-Develop Apache Spark jobs and create higher level abstractions to simplify deploying new Spark jobs-Create Airflow operators, hooks, and security manager; perform Airflow upgrades-Perform peer code reviews, review pull requests; provide mentorship-Manage Airflow and Spark builds, testing, and deployments using container technology and CI/CD tools-Develop and maintenance REST API-Integrate data sources, CRM platform, and data analysis tools-Deliver data solutions with complex requirements and changing needs-Analyze and document various source databases-Engage stakeholders to collect requirements for transformation, data enrichment, and final deliverables.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.