Anshul Sharma
Databricks Engineer @Microsoft
Signup · Get unlimited contacts
WORK HISTORY
Databricks Engineer @Microsoft
Toronto, ON, CA
Azure Databricks & Big Data Processing: Troubleshoot and resolve complex technical issues in Azure Databricks, Apache Spark, ADF, Synapse, and Azure Storage, ensuring seamless data integration and high-performance processing. • Performance Optimization: Tune Spark jobs, optimize cluster configurations, and implement cost-saving strategies for efficient resource utilization and scalable big data workloads. • Networking & Security: Resolve VNET, Private Link, firewall, and network connectivity issues, while enforcing RBAC, IAM policies, and access control for secure data pipelines. • Root Cause Analysis & Debugging: Conduct deep-dive RCA on failed Spark jobs, cluster failures, and security incidents using Spark UI, job logs, and execution plans to improve system reliability. • Monitoring & Automation: Leverage Azure Monitor, Log Analytics, and Application Insights to track performance, detect anomalies, and proactively prevent failures. • Global Collaboration: Work with cross-functional teams across time zones, delivering scalable, high-availability data solutions that drive business impact. • Documentation & Knowledge Sharing: Maintain comprehensive troubleshooting guides and technical documentation, enabling faster issue resolution and continuous process improvement.
EDUCATION
Gujarat Technological University (GTU)
Bachelor of Engineering - BE, Computer Science
University of Windsor
Master of Applied Computing - MAC, Artificial Intelligence
ABOUT ANSHUL SHARMA
I am a Data Engineer with 5+ years of experience in big data processing, cloud-based data…
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.