Kirtan Suvarna

Azure Data Engineer @Infinite Computer Solutions

TX, US

Designed and maintained scalable ETL/ELT pipelines leveraging Databricks to process large-scale datasets.• Utilized PySpark/Spark and SQL for efficient data transformation and processing.Integrated data from diverse sources, including Azure Blob Storage, ADLS, and various relational/non-relational systems.• Partnered with cross-functional teams to gather business requirements and deliver tailored data solutions.• Prepared and optimized datasets for dashboards and BI tools to support data-driven decision-making.• Optimized Databricks workloads to enhance cost efficiency and performance.• Monitored and troubleshot data pipelines to ensure accuracy, reliability, and seamless operation.• Implemented robust data security, access controls, and governance standards using Unity Catalog.Ensured compliance with organizational and regulatory data policies.• Deployed Databricks jobs, notebooks, and configurations across environments using Databricks Asset Bundles.• Managed version control and adhered to development best practices for Databricks artifacts.• Managed and organized code repositories using Azure DevOps Repos to ensure seamless collaboration and version control.• Reviewed and merged pull requests to maintain clean, optimized, and bug-free codebases.

The University of Texas at Arlington

Master's degree, Computer Science