Gregory Greg Smith
Leader / Creator | Senior Software/Data Engineer @ Twilio Segment
- Role
- Senior Software Engineer at Twilio
- Location
- Raleigh, NC, US
- LinkedIn followers
- 500 followers
About Gregory Greg Smith
Deeply dedicated to driving the development and design of durable distributed data systems depended on for decisive discoveries.Personal Bio & Fun Facts | gamer; chess nerd; guitarist/musician; perpetual student of philosophy/theology; camping and hiking for digital detoxing; unofficial UI/UX critic; foodie; cat dad; tattoos.*thoughts and opinions are my own and do not reflect the thoughts or opinions of any organizations I am part of*
Experience
Senior Software Engineer
Feb 2024 — Present · San Francisco, CA, US
Worked closely with external field engineers to fine-tune ~50 Databricks Jobs responsible for ingesting/maintaining a sustained 500k records-per-second into a multi-petabyte Delta Lakehouse that will soon power Segment\'s customer data profiles across all product offerings (Profiles Data Lake).Drove down AWS S3 costs (storage + API requests) for the Profiles Data Lake by 300%.Owned operational readiness and excellence for Profiles Data Lake \"go-live\", ensuring a resilient Data Platform complete with: real-time systems monitoring via DataDog; custom dashboard panels; Slack alerting; GDPR/CCPA/BCR compliance; PagerDuty integration; & internal documentation/runbooks.Introduced & productionalized concurrent patterns in Scala/Spark allowing multiple tenants/customers to process at the same time; ultimately decreasing job runtimes by 44% on average while increasing cluster worker/executor CPU utilization by 8x on compute-heavy tasks.Assisted in the initial setup of a cloud-to-cloud migration process using Python, Apache Airflow, GCP, AWS [Athena/Glue/MWAA/S3/Lambda/StepFunctions], Scala, and Databricks; ultimately allowing our team to automate our migration & backfill processes.
Education
Western Michigan University
Bachelor of Science - BS, Data Science | Minor in Computer Science
2016 — 2019
Grand Rapids Community College
Associate’s Degree, General Studies
2013 — 2016
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.