Venkatabagavan Pbv
Sr Associate - Projects @Cognizant
Signup · Get unlimited contacts
WORK HISTORY
Sr Associate - Projects @Cognizant
ON, CA
I’ve been working as a Senior Data Engineer/Architect on an enterprise Azure data platform, modernizing legacy Hadoop/Hive workloads into a cloud-native, governed, and resilient architecture- Designed and delivered enterprise ETL frameworks using Azure Data Factory and Azure Databricks, migrating large-scale batch pipelines into ADLS Gen2 and Synapse Analytics to improve scalability and maintainability- Built PySpark transformation pipelines using Delta Lake Medallion Architecture (Bronze, Silver, Gold), enabling incremental processing, schema enforcement, and audit-ready history, reducing data reconciliation issues drastically- Automated end-to-end orchestration and dependency management through parameterized ADF pipelines integrated with Databricks job clusters, improving SLA and pipeline reliability by ~25%- Led technical design and delivery, owning HLD/LLD reviews, mentoring engineers, enforcing coding standards, and aligning solutions with enterprise governance and security controls- Collaborated closely with Product Owners, BSAs, Architects, and DevOps teams in an Agile Scrum model, ensuring predictable sprint delivery and production-ready releases- Supported Change Management and Production deployments, coordinating CAB approvals, validation, and incident resolution and contributing to ~20% faster release cycles.#DataEngineering #Azure #Databricks #ADF #DeltaLake #CloudArchitecture #ETL #Leadership #BankingTechnology
EDUCATION
Osmania University, Hyderabad
Master of Computer Applications - MCA, Computer applications
ABOUT VENKATABAGAVAN PBV
With over 15 years of experience in designing scalable data pipelines and delivering cloud-native solutions, I specialize in building and optimizing ETL/ELT workflows using tools like BigQuery, Dataflow, Dataproc, Azure Data Factory, ADLS Gen2, Databricks and governance standards using Unity Catalog. I\'m skilled in SQL, Python, Apache Kafka, and modern data warehousing across industries including banking, healthcare, and pharma. I thrive on aligning technical teams with business stakeholders, ensuring seamless collaboration and impactful delivery, leading sprint planning, refining feature stories, and supporting agile delivery. I conduct peer code reviews, drive collaboration, and ensure smooth, reliable deployments through CI/CD and orchestration frameworks. Certifications- Google Cloud Professional Data Engineer- Microsoft Azure & Fabric Data Engineer Associate- Databricks Data Engineer Associate
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.