Ganesh Bollapalli

About Ganesh Bollapalli

Hi, I\'m Ganesh, a passionate Data Engineer with 4.6 years of experience in building data…

Experience

1. Senior Data Enginner

   LTIMindtree

   Dec 2023 — Present · Hyderabad, IN

   Refined Raw Data into Consumable, quality information that\'s ready for analytics by creating high quality Data Assets in Spark Scala Developed and Enhanced Data pipelines to support critical business processes and ensure data quality and integrity. Cataloguing and monitoring data assets, ensuring all data sources are properly tracked, documented, and easily accessible. Conducting Performance tuning and Optimization of the data workflows, which improved processing speed by 20% and reduced computational costs by 15% Collaborating with the business team to define and implement retention policies, ensuring data lifecycle management aligns with business requirements and regulatory standards Implemented CI/CD pipelines using Jenkins to automate software delivery and accelerate the software delivery cycle, reducing deployment time by 25% and ensuring faster release cycles. Scheduled and monitored jobs using Apache Airflow, streamlining workflows and reducing job failures, ensuring timely execution and better resource utilization. Utilized Prophecy for building low-code data pipelines, significantly speeding up the development process and reducing manual coding efforts, improving pipeline deployment efficiency.