Hari Prasanna Rameswarapu

About Hari Prasanna Rameswarapu

I’m Prasanna Rameswarapu, a Data Engineer with 4+ years of experience in PySpark, AWS, Snowflake, Airflow, Kafka, and ETL pipeline development. I have a strong track record of designing scalable data pipelines, optimizing SQL and data models, and building real-time streaming solutions using Kafka + Spark Structured Streaming.My expertise includes AWS S3, Glue, Lambda, Athena, EMR, Snowflake schema design, data quality automation, and end-to-end pipeline orchestration. I work extensively with Python, SQL, data transformations, cloud data engineering, and modern big data ecosystems.I’m passionate about building efficient, automated, and reliable data systems that enable analytics, reporting, and business insights at scale.

Experience

1. Data Engineer

   Hillcrest Bank

   Nov 2024 — Present · Dallas, TX, US

   o Worked closely with Business Analyst to understand business requirements and start deriving solutions accordingly.o Worked with Data Engineers and Data Analysts into a cross functional team for the deployment of models and working of the projects.o Built and optimized PySpark ETL pipelines for financial data ingestion.o Developed real-time streaming pipelines using Kafka + Spark Structured Streaming.o Implemented windowing, checkpointing, and error-handling frameworks.o Automated workflow management using Apache Airflow.o Built real time data pipelines by developing Kafka producers and Spark streaming applications for consuming.o Designed and developed scalable ETL pipelines using PySpark for financial datasets.o Automated workflows in Airflow, enabling scheduled processing and quality checks.o Developed AWS Glue ETL jobs to transform and curate healthcare datasets.o Implemented event-driven data ingestion using Lambda & S3 triggers.o Designed schemas and managed metadata using Glue Catalog & Crawlerso Consumed and processed real-time streaming events using Kafka + Spark Structured Streaming.o Implemented window-based aggregations, checkpointing, and error-handling logic to ensure reliable event processing.o Built and maintained Snowflake schemas (staging, integration, analytics layers).o Validated and cleaned datasets using Python and SQL, improving data accuracy.o Processed data from S3, APIs, and internal systems into the analytics environment.o Extracted data using PL/SQL queries, cleaned, imputed missing values and made the datasets ready for analysis and visualization on Tableau.

Education

• Gandhi Institute of Technology and Management (GITAM)

  Bachelor's degree, Biotechnology, Microbiology and Chemistry

• University of Illinois Springfield

  Master's degree, Management Information Systems, General