Kamal Panchal
Data engineer | Actively Seeking Full-Time Opportunities | MSDA (SJSU \'23) | Google Data Analytics Specialization | Big Data | Data Pipelines | ETL | AWS | SQL.
- Role
- Data Engineer at Apple
- Location
- San Jose, CA, US
- LinkedIn followers
- 500 followers
About Kamal Panchal
Our team at Apple harnesses the power of AWS and Databricks to innovate automated…
Experience
Data Engineer
Aug 2024 — Present · Austin, TX, US
Designed and implemented a fully automated vulnerability scanning system using AWS (S3, Lambda, ECS, ECR), integrated with Databricks for data processing and analysis, reducing vulnerability detection time by 30%.• Developed a real-time ETL pipeline to ingest and analyze Docker image vulnerability data, leveraging AWS Kinesis andDatabricks for deep insights, real-time anomaly detection, and proactive mitigation, reducing potential downtimes by 20%.• Automated the generation of detailed security reports for compliance with industry standards such as CIS benchmarks,reducing manual efforts by 50% and streamlining the vulnerability management process.• Optimized over 200 legacy SQL queries, achieving a 10x improvement in query performance and significantly enhancing data processing speeds in the Data Lake.• Designed and implemented a scalable ETL pipeline using AWS Glue and AWS Redshift, reducing data processing times by 35%.• Led the migration of legacy on-premise ETL systems to AWS Cloud architecture, resolving historical bottlenecks and improving system uptime to 99.9%.• Collaborated with cross-functional teams to ensure ETL pipelines adhered to SLAs, cutting operational costs by 20%.• Monitored and maintained data pipelines using AWS CloudWatch, automating alerts to ensure rapid issue resolution and minimal downtime.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.