Vishwanath G

Senior Data Engineer @QBE Insurance

NY, US

Designed and implementation of data warehouse solutions in Teradata for large-scale analytics. Optimized SQL queries and managed ETL pipelines for performance in a Teradata environment, focusing on data integration and data transformation in the insurance domain.• Leverage GCP services such as BigQuery, Datafusion, Pub/Sub, and Composer to build scalable, secure, and cost-effective data solutions.• Implemented microservices architecture using FastAPI, Docker, and Kubernetes for efficient application deployment.• Developed & maintain ETL/ELT data pipelines using Datafusion, Dataflow, and Pub/Sub to ingest, transform, and load data into BigQuery.• Ensure the smooth flow of data through pipelines and optimize for performance, scalability, and reliability.• Used Composer (Airflow) for orchestration of workflows and automation of data processing tasks.• Designed, implemented optimized data models in BigQuery to support analytics, reporting, and data-driven decision-making.• Deployed APIs on Cloud Run for scalable and serverless execution.• Optimized performance of data pipelines, BigQuery queries, and machine learning workflows.• Automated deployment and management tasks using CI/CD pipelines, ensuring continuous integration and delivery of code changes.• Developed Jobs/pipelines that read the data from sources as flat files and load into Tables and Datasets.• Used rest API with Python to ingest Data from and some other site to BIGQUERY.• Integrated GCP Looker for real – time data visualization, improved dashboards responsiveness, leading to a 20% increase in overall analytical efficiency. • Implemented end-to-end data solutions using BigQuery, Cloud SQL, and Datafusion, supporting real-time analytics and business intelligence.• Developed ETL pipelines for the insurance domain using Teradata as the backend database• Designed & optimized data models for large-scale data warehousing solutions in BigQuery.

University of Maryland Baltimore County

Master's degree