Bhavya B

Experience

1. Sr Data Engineer

   Goldman Sachs

   Sep 2023 — Present · New York, NY, US

   Experienced in leveraging the Azure Cloud platform, including HDInsight, Data Lake, Databricks, Blob Storage, Data Factory, Synapse, SQL, and SQL Data Warehouse, I specialize in designing, configuring, and optimizing data pipelines to meet complex business requirements. My expertise spans data ingestion and ETL processes using Azure Data Factory, Databricks, and Spark SQL, enabling the seamless transfer and transformation of data across services like Azure Data Lake, Storage, SQL, and Data Warehouse.I have a strong foundation in Azure architecture, having designed relational databases and configured Azure Functions with Cosmos DB bindings for real-time data processing. Proficient in Spark applications within Databricks, I extract, transform, and aggregate data from multiple sources to deliver valuable insights into customer behavior. I frequently utilize JDBC connectors for ETL operations, ensuring efficient data processing.My background includes automating cloud infrastructure using PowerShell for resource creation, storage management, and firewall configuration. I have developed Elastic Pool databases, scheduled T-SQL procedures, and created automated ETL pipelines over Snowflake using Apache Spark and PySpark, consolidating data in data marts with star schemas for improved analytics.With hands-on experience in CI/CD, I utilize Azure DevOps, GitHub, and VSTS for version control, authentication, and role-based security. Additionally, I employ Spark Streaming for real-time analytics, Scala for parallel processing, and Power BI for interactive, secure client reports. Through collaboration, branching strategies, and data governance, I ensure reliable, scalable, and secure data solutions that align with business goals and compliance requirements

Education

• Gudlavalleru Engineering College, Seshadri Rao Knowledge Village, Gudlavalleru, PIN-521356(CC-48)

  Bachelor's degree