Reddy P

About Reddy P

I’m a cloud-focused Data Engineer with hands-on experience building and operating reliable batch and streaming data pipelines that power analytics, marketing, product, and machine learning teams.Here’s the thing: I spend most of my time turning messy, high-volume data into analytics-ready datasets that teams can actually trust and use. I’ve designed Medallion and Lakehouse architectures, built real-time pipelines with Kafka and Spark Streaming, and optimized large-scale warehouses in Snowflake and Redshift for both performance and cost.I work primarily with Python, SQL, PySpark, dbt, and Airflow across Azure, AWS, and GCP environments. My experience spans real-time campaign analytics, personalization platforms, CRM data hubs, and telemetry systems, with a strong focus on data quality, governance, and production reliability.Recently, I’ve been building near-real-time analytics platforms for influencer and marketing data, and experimenting with GenAI-enabled pipelines including embeddings, vector search, and RAG-style workflows using OpenAI, Pinecone, and LangChain.What I value most is clean architecture, strong documentation, and pipelines that don’t break at 2 a.m.If you’re building data platforms that need to scale, stream, or support ML and GenAI use cases, happy to connect.

Experience

1. Data Engineer

   Crowdcore

   Jan 2025 — Present · Dover, DE, US