Vamsi K

Data Engineer @Bank of America

Dallas, TX, US

Collaborated with business stakeholders to gather requirements, analyze data needs, and design scalable, compliant data engineering solutions.Built real-time streaming pipelines using PySpark, Flink, and Kafka on Hadoop clusters for anomaly detection and risk monitoring.Developed ETL pipelines on GCP using Airflow and BigQuery, automating ingestion and transformation from heterogeneous sources.Migrated on-prem Hadoop systems to GCP, enabling elastic scaling, reduced costs, and improved performance.Designed applications with Spark, Scala, Python, NiFi, AWS S3/EMR, integrating hybrid cloud platforms.Automated ML pipelines using Spark MLlib and Python, embedding predictive models into real-time workflows.Integrated Redis and Couchbase for real-time caching and scalable NoSQL storage of semi-structured data.Orchestrated a Data Governance framework, defining stewardship roles, enforcing policies, and automating compliance checks.Built monitoring dashboards in Splunk and Tableau, enabling real-time visualization, anomaly detection, and proactive alerts.Designed and implemented a microservices architecture using Kafka and Docker, improving scalability and fault isolation.Optimized Spark and PySpark jobs with advanced join strategies and partitioning, reducing runtimes by 30%.Developed CI/CD pipelines with Git, Jenkins, and Docker, ensuring consistent, automated deployments across environments.Authored detailed technical and functional specifications and conducted knowledge transfer sessions for team enablement.Supported enterprise Big Data analytics platforms in production, ensuring reliability, performance, and regulatory compliance.

University of North Texas

Business Analytics