Rambarki Deepak
Data Engineer @ Charles Schwab specializing in real-time data pipelines | Python, Spark, Snowflake, SQL | | Cloud, Big Data & ETL Expert | Open to Full-Time Roles
- Role
- Data Engineer at Charles Schwab
- Location
- Dallas-Fort Worth, TX, US
- LinkedIn followers
- 500 followers
About Rambarki Deepak
AI Engineer with 5+ years building production-scale machine learning systems that deliver…
Experience
Data Engineer
Dec 2024 — Present · US
Built 12+ real-time data pipelines using Apache Kafka and Spark Structured Streaming to support high-frequency trading, reducing marketdata ingestion latency to under 2 seconds across equities and options processing systems.• Migrated over 30TB of legacy trading and transaction data to AWS S3 and Redshift, achieving a 40% reduction in query latency and cuttingmonthly infrastructure costs.• Created automated ETL workflows in Apache Airflow for risk and compliance reporting, improving on-time report delivery across 10regulatory submission processes.• Engineered dimensional models for investment performance reporting in Power BI, supporting 100+ financial advisors with near real-time updates and reducing ad-hoc data requests.• Integrated Spark-based enrichment logic into batch pipelines to validate trading transactions, increasing data accuracy by 35% whilemaintaining pipeline execution times under SLA thresholds.• Enforced access policies with AWS IAM and audit logging for internal and third-party data consumers, fully aligning with SOX, GDPR, andinternal data governance standards.• Reduced data duplication across environments by 70% through implementation of data cataloging and version control, allowing teams toreuse trusted datasets across research and portfolio analysis teams.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.