Vamshikrishna Reddy

About Vamshikrishna Reddy

Analytics-focused Data Engineer with 4+ years of experience designing and implementing scalable ETL pipelines, data models, and warehousing solutions. Advanced in SQL, Python, dbt, and orchestration tools like Airflow on AWS to deliver reliable metrics, canonical datasets, and self-serve dashboards that enable data-driven decision making across teams.

Experience

1. Data Engineer

   Scholastic

   Aug 2021 — Present · NY, US

   Designed an agentic AI solution to translate natural language prompts into optimized SQL queries and deliver summarizedquery outputs to business users.•Built an AI agent to parse DML statements and construct table and column level graph data lineage across Redshift databases.•Deployed AI agents in AWS AgentCore using Docker containers and AWS ECR.•Developed a monitoring framework to track data observability, including data freshness, volume, and schema-change alertsfor critical pipelines.•Conducted requirement analysis, development, testing, and deployment of batch and stream data ingestion pipelines and ETL jobs.•Proficient in data storage, warehousing, instance management, and security management on the AWS Cloud Platform.•Orchestrated data workflows using Airflow DAGs, Glue Jobs, Ctrl-M, and Cron-job scheduling.•Integrated with Salesforce for data import/export operations using Python.•Utilized Glue crawlers to detect latest partitions in S3 and create Net-Change and Staging tables in Redshift and RDS.•Managed AWS services using Terraform (IaC) and automated tasks with Python and Boto3.•Wrote dbt models and SQL scripts for full load, truncate load, and deduplication to create Staging, Fact, and Dimension tableson Redshift.•Optimized storage and processing by leveraging file formats like Parquet, JSON, and CSV based on data needs.•Automated and managed production job execution using Jenkins on AWS EC2.•Utilized GitHub and Bitbucket for version control and efficient code collaboration.•Diagnosed and resolved complex production issues using advanced troubleshooting techniques.•Designed and managed data ingestion frameworks to consume messages from Kafka, retrieve data via internal APIs.

Education

• University of Maryland Baltimore County

  Master of Science - MS, Data Science

  2019 — 2021

• Vellore Institute of Technology

  Bachelor of Technology - BTech, Mechanical Engineering