Bhargavi D

About Bhargavi D

I am a Data Engineer with over 8 years of expertise in the field. My journey in data…

Experience

1. Senior Data Engineer

   U.S. Bank

   Aug 2023 — Present · US

   Developed comprehensive data engineering projects, specializing in the design and implementation of end-to-end solutions across various Azure services. Managed data ingestion into Azure Data Lake, Azure Storage, Azure SQL, and Azure Data Warehouse, followed by efficient processing in Azure Databricks. Integrated Azure Data Factory and Azure Synapse Analytics with external services, enhancing functionality by incorporating machine learning models and connecting with third-party data providers.Deployed data processing algorithms and workflows within Azure HDInsight to improve overall performance and reduce processing time. Contributed to the development of informatica mappings, preparing design documents, technical design documents, and unit acceptance testing documents, Designed scalable and reliable data integration solutions using informatica power center to accommodate growing data volumes and meet business requirements.Developed and maintained data warehousing solutions using python, ensuring structured storage and easy access for analytical purposes Implemented CI/CD pipelines with jenkins to automate testing and deployment of python-based data engineering solutions, enhancing reliability and speed.Designed and implemented fault-tolerant Spark and Kafka architectures to guarantee data integrity and system reliability. Conducted regular code reviews to ensure adherence to best practices and efficiency of Spark code. Developed reusable spark scripts and functions for data processing in different pipelines and Kafka stream processors for data transformation, enrichment and cleasning.Dev

Education

• University of North Texas

  Master's degree