Wednesday, October 22, 2025

Show HN: Incremental JSON parser for streaming LLM tool calls in Ruby https://ift.tt/XFTVYW1

Show HN: Incremental JSON parser for streaming LLM tool calls in Ruby Built this for streaming AI tool calls. LLMs stream function arguments as JSON character-by-character. Most parsers reparse from scratch each time - O(n²) behavior that causes UI lag. This maintains parsing state, processing only new characters. True O(n) performance that stays imperceptible throughout the entire response. Ruby gem, MIT licensed. Would love feedback. https://ift.tt/YEKdC7z October 22, 2025 at 11:32PM

No comments:

Post a Comment