Devi C. Peruri

About Devi C. Peruri

As a Senior Data and AI Consultant with 9+ years of experience, I specialize in driving data transformation and leveraging AI to deliver innovative, scalable solutions. My expertise lies in building robust data pipelines, implementing data quality, governance frameworks, and using advanced AI/ML, and visualization technologies to turn complex data into actionable insights that power business decisions.I have experience in architecting and optimizing both batch and real-time data pipelines, ensuring seamless integration across cloud and on-premise environments. I work with cutting-edge technologies such as Snowflake, Databricks, Azure, AWS, GCP, and have a strong foundation in APIs, DevOps containerization, monitoring and automation to maximize data efficiency and scalability.My recent work also includes exploring Generative AI and Machine Learning, where I co-authored a whitepaper on enhancing chatbots using Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG). I am particularly passionate about the potential of Agentic AI and its ability to drive autonomous decision-making in data-driven systems.I am committed to creating impactful solutions that solve critical problems and enhance people\'s lives. Additionally, I enjoy mentoring teams, leading data strategy discussions, and exploring new innovations in Data, AI, and automation.

Experience

1. Senior Data and Ai Engineer

   Thoughtworks

   Sep 2021 — Present · Austin, TX, US

   Key Achievements: Scalable Data Pipelines & Engineering• Designed and managed batch pipelines using Python, DBT, Apache Airflow, Kubernetes, processing 5TB+ of data daily. Improved data delivery by 60%, reduced failures by 40%, and contributed to $5M in revenue growth.• Built enterprise-scale data pipelines leveraging low code tools like Informatica, Matillion, and Azure Data Factory, eliminating 180+ hours of manual effort per month and boosting processing efficiency by 30%. GenAI & APIs • Enhanced chatbot functionality by integrating Azure OpenAI LLMs & Retrieval Augmented Generation (RAG), improving accuracy and response relevance by 70%.• Developed health check APIs for Azure-based data platforms, integrated with Dynatrace, improving platform availability by 30%, cutting downtime by 60%, and reducing manual troubleshooting by 90%. Data Strategy & Governance• Implemented Data Cataloging & Governance frameworks using Azure Purview, enhancing metadata management, data lineage tracking, and compliance. Improved data discoverability by 40% and reduced regulatory risks.• Developed post-DataMesh rollout KPIs dashboards, illustrating a 25% increase in data quality, 30% improvement in data accessibility, and 40% reduction in governance issues, enabling better business decisions. Mentorship & Leadership• Mentored senior and lead software developers, data analysts, quality analysts transitioning into data engineering, sharing expertise in Data Modeling, ETL, ELT, Medallion architecture, Spark, and Cloud Engineering, helping them excel in data-driven roles.Technical Stack: Data Strategy & Governance: Data Mesh, Data Cataloging (Azure Purview), Collibra Data Engineering: Python, DBT, Apache Airflow, Informatica, Matillion, Azure Data Factory Cloud & Infrastructure: Snowflake, Databricks, Azure, AWS, GCP, Terraform, Docker, Kubernetes🤖 AI & NLP: Generative AI, LLMs, RAG, Azure OpenAI, Natural Language Processing (NLP)

Education

• University of Nevada-Las Vegas

  Master's degree, Computer Science

  2015 — 2017