Sagar Pavade

About Sagar Pavade

Having 12 years of Experience in Analysis, Development, Implementation and…

Experience

1. Senior Software Data Engineer

   HCLTech

   Jan 2023 — Present · Navi Mumbai, IN

   Performing Data Product Onboarding. • Working on IP whitelisting and private link endpoints. • Implementing OAuth and Key Pair Authentication to connect to ADF and Databricks. • Creation of network policy. • Creation of warehouses based on workload demands. • Using materialized view and clustering keys. • Add Row Level security and column level security. • Use Time Travel and fail safe to recover the lost data. • Set up Resource Monitors to manage warehouse usage and avoid overuse. • Tracking query logs of users and their activities for security purpose. • Basic trouble shooting of failed dbt objects, runtime issues. • Understanding of dbt workflow, including development, testing, and deployment. • Set up Role-Based Access Control (RBAC) to manage user permissions. • Create and assign roles, users, and warehouses for different teams. • Create and manage databases, schemas, tables, and views. • Implement Row Access Policies to restrict data visibility. • Integrate Snowflake with Azure Data Factory, Databricks, and third-party ETL tools. • Implemented basic private endpoints to secure Azure service connections to Snowflake. • Established Azure Linked Services for seamless data integration between ADF to Snowflake. • Managed Azure Active Directory (AAD) groups for user access control and resource allocation. • Perform the DBT Onboarding. • Train new users on Snowflake basics, query writing, and optimization. • Provide support for teams integrating Snowflake with other systems. • Driving the daily support and weekly client calls. • Preparing cost estimation monthly sheet for client.

Skills

• Teradata Sql
• Databases
• Etl
• Microsoft Sql Server
• Teradata Data Warehouse
• Asp.net