Kaustubh Pathak
Data Engineer/Scientist | Software Engineer - 2 @ Dell | Ex - Data Scientist Intern @ Rakuten | Ex - ETL Developer Intern @ Lambdatest
- Role
- Software Engineer - 2 at Dell Technologies
- Location
- Etawah, UP, IN
- LinkedIn followers
- 500 followers
About Kaustubh Pathak
Data Engineer, Data Scientist and Software Developer with strong math background and 6+…
Experience
Software Engineer - 2
May 2022 — Present · Bengaluru, IN
Implemented Remediation platform for Server connection that seamlessly connect client and dell servers using Api interface to resolve Client server problems using Argo, Golang• Implement custom pipelines with argo workflow for Kubernetes artitecture and in Apache airflow for non-kubernetes artitectures.• Implement custom inputs plugins(Redfish, SNMP Trap) and outputs plugins(Message bus, HTTP) in Telegraf to handle large number of requests(10 Million+/day) in real time.• Automated the Streaming Services using Docker, Kubernetes and Azure with help of Spark/Scala.• Working as SWE-2 to perform daily Backend Operations and Dataops Tasks.• Involved in Development, Testing and Maintenance of Spark Jobs in Java/Scala.• Worked on ETL pipelines to preprocess data from Various Sources(Azure Eventhub, DBFS, Blob Storage).• Involved in deployment process for Spark Jobs over HDInsight and Databricks.
Education
St. Mary's Inter College , Etawah
Intermediate, PCM with Computer Science
2016
ABV-Indian Institute of Information Technology and Management
Integrated M.Tech , Information Technology
2017 — 2022
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.