Srinivasareddy Guduru

WORK HISTORY

EDUCATION

ABOUT SRINIVASAREDDY GUDURU

10+ years of experienced lead data engineer with expertise in designing,implementing, and optimizing scalable data pipelines and architectures.• 6+ years of proficiency in Kafka, Container Apps, Azure Cloud services usingDatabricks, Azure Data Factory, Azure Logic App, ADLS Gen2, Azure SQL, AzureAPI gateway and EventHub.• 6+ years of hands-on distributed computing development experience and strongprogramming skills in PySpark, Spark SQL for data manipulation, cleansing, andanalysis, with a focus on optimizing PySpark jobs for large-scale data processingand performance tuning using Databricks.• In-depth development experience on Kafka event-driven distributed messagestreaming using Confluent Kafka platform for low latency architecture.• Advanced understanding of designing and building for data quality assuranceusing PyTest and implemented new scalable solutions.• Extensively used PySpark, Python for data transformations, data streaming andbatch processing from sources Delta lakes, EventHub and Kafka.• Solid knowledge of DevOps Concepts, Cloud Architecture, and Azure DevOps,GitHub Actions, and Pipelines.• Experience with ELT and ETL Data Pipeline solutions from inception toproduction using Medalion architecture.• Expert in providing cost effective and optimized solution based on the businessrequirements.• Led the migration of Databricks applications to containerized environments usingDocker, significantly improving deployment efficiency and resource utilization.Implemented Docker-compose for orchestrating multi-container applications,streamlining development-to-production workflows.