Prem Chand Pasupuleti

About Prem Chand Pasupuleti

I am a Senior Data Engineer with 10+ years of experience designing and delivering…

Experience

1. Senior Data Engineer at Charles Schwab

   Charles Schwab

   Mar 2023 — Present

   As a Senior Data Engineer, I design and implement scalable, event-driven data pipelines on Google Cloud Platform using tools like Dataflow, Pub/Sub, and BigQuery to support real-time and batch processing. I build ETL workflows with DBT, Apache Spark, and PySpark, handling both structured and unstructured data efficiently. I’ve implemented robust data governance using Databricks Unity Catalog and managed OLTP systems on Cloud Spanner for high-performance transactional workloads. My work includes developing advanced SQL transformations with CTEs, Celonis process mining tools, ERP, window functions, and UDFs, optimizing BigQuery with partitioning and sharding, and leveraging Hadoop and Dataproc for large-scale batch processing. I integrate ML models using Google Cloud AI Platform and maintain observability with the Cloud Operations Suite. I’ve automated workflows with Cloud Composer and Cloud Functions, deployed APIs in Python and JavaScript, and enforced security through IAM and RBAC policies. I also lead infrastructure automation using Terraform, CI/CD with Jenkins, containerization with Docker and Kubernetes, and data modeling with Erwin. Additionally, I design BI dashboards with Google Data Studio, track behavior analytics via GA4, and follow Agile methodologies using JIRA.

Education

• SRM IST Chennai

  Bachelor of Technology - BTech, Computer Science