Jay Pathak

Experience

1. Sr Principal Software Engineer, Core Search

   Splunk

   Jan 2017 — Present · San Francisco, CA, US

   Tech lead for Search/Analytics at Splunk. My team is responsible for the code running all (400M/day) searches at Splunk, both on-prem / cloud.Some of my recent projects include- Architect on re-designing the analytics underpinnings of Splunk to separate storage and compute for increased scale and resiliency, creating a phased approach to enable this transition to happen on a multi-decade legacy codebase- Designed / implemented a new hybrid schema system which delivers both the flexibility of search-time + the performance of index-time fields- Designed / implemented from scratch aggregation / distributed statistics for very large datasets (Splunk\'s bread-and-butter stats command)- included designing a custom wire/at-rest data format, improved performance by 4x- Designed / implemented lookups/join functionality - re-architected lookups to allow easily adding new data sources to join against while improving performance. Other projects- Tech lead on designing / implementing Splunk\'s search observability / telemetry framework used by all platform teams at Splunk- Optimizing search queries with semantic analysis/AST. Contributed to Splunk\'s search optimizer framework- Worked on components of the Splunk Cloud Services / conf system connecting search catalog and splunkd.

Education

• North Carolina State University

  Masters, Computer Science

Skills

• Tcp/Ip
• Software Engineering
• Programming Languages
• Playstation 3
• Networking
• Android
• Debugging
• Software Development
• Gnu Debugger
• Software Packaging
• Wireless
• Java
• Google Tv
• C++
• Javascript
• Software Design
• Perl
• Nat
• Embedded Systems
• C
• Udp
• Consoles
• Visual Studio
• Eclipse
• Algorithms
• Ps3
• Testing
• Wireshark
• Distributed Systems
• Linux