Duhita Jagdev

About Duhita Jagdev

As a Big Data Engineer with over a year of experience at Jio Platforms Limited, I specialize in managing and optimizing big data environments, with a strong focus on Apache Kudu, ETL processes, and telco data. My expertise spans across the design and implementation of high-performance data pipelines, managing large-scale data migrations, and building insightful dashboards to ensure effective data visualization and monitoring. In my role, I’ve gained hands-on experience in Apache Kudu Administration, driving improvements in data storage and processing efficiency. I am also proficient in working with Apache NiFi for intracluster data migration, optimizing data flows, and ensuring seamless data transfer. Additionally, I have built and deployed Kudu-based dashboards, which help in data monitoring, reporting, and troubleshooting. I am passionate about leveraging big data technologies to provide actionable insights and drive data-driven decision-making. I thrive in dynamic, fast-paced environments and am always looking for new ways to improve and scale complex data systems.

Experience

1. Big Data Engineer

   Jio Platforms Limited Jpl

   Dec 2023 — Present · Navi Mumbai, IN

   As a Big Data Engineer at Jio Platforms Limited, I am responsible for managing and optimizing the company’s data infrastructure and pipelines, specifically focusing on Apache Kudu and telco data. My role includes:Apache Kudu Administration: Manage the Kudu database environment, ensuring high performance, scalability, and fault tolerance of data storage and processing.ETL Pipeline Development: Design, implement, and optimize ETL pipelines for large-scale data processing, ensuring efficient extraction, transformation, and loading of telco data from multiple sources into Hadoop-based systems.Apache NiFi Implementation: Utilize Apache NiFi for intracluster data migration, facilitating smooth data flows across clusters, improving data synchronization, and streamlining internal processes.Dashboard Creation for Kudu Database: Develop and maintain custom dashboards to monitor the health and performance of Kudu databases, enabling proactive management and quick issue resolution.Telco Data Management: Work closely with large-scale telco datasets, ensuring proper data quality, integrity, and efficient querying for actionable insights.Collaboration with Cross-Functional Teams: Work with data scientists, analysts, and other engineers to align on best practices and optimize the flow of data across various business units.

Education

• ACROPOLIS INSTITUTE OF TECHNOLOGY AND RESEARCH

  Bachelor of Technology - BTech