Basava Manasa Koyi
Data Engineer @Midas Automate
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Midas Automate
Houston, TX, US
Building scalable ETL/ELT pipelines using Apache Airflow and Python processing 10M+ records daily. • Designed ingestion workflows on AWS (S3, Glue, Lambda, Redshift) and Azure Data Factory reducing pipeline latency by 35%. • Developed real-time streaming pipelines using Kafka and Spark Structured Streaming for analytics dashboards. • Automated data validation frameworks using PySpark and Pandas, reducing data errors by 40%. • Built data models supporting Power BI and Tableau dashboards used by multiple business units. • Optimized Spark processing with partitioning and bucketing, improving query performance by 50%. • Documented pipeline architecture and data lineage to support governance and compliance.
EDUCATION
Oklahoma City University
Master of Science - MS, Data Analytics
KKR&KSR Institute of Technology & Sciences, VINJANAMPADU Village (CC-JR)
Bachelor of Technology - BTech, Electrical and Electronics Engineering
ABOUT BASAVA MANASA KOYI
Data Engineer with 3+ years of experience building scalable cloud data pipelines and analytics platforms across AWS, Azure, and Google Cloud.Skilled in Python, SQL, Apache Spark, Kafka, and Airflow to design ETL pipelines, process large datasets, and support real-time data processing.Experienced in building data architectures using AWS, Azure, and BigQuery, enabling business teams to access reliable datasets for analytics and dashboards using Power BI and Tableau.Passionate about designing efficient data platforms that transform raw data into actionable insights.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.