TOON vs JSON: why smaller doesn't mean cheaper for LLMs
TOON looks more compact than JSON, but a 9,649-test study found it cost LLMs 38% more tokens. The reason: model training distribution beats format size.
TOON looks more compact than JSON, but a 9,649-test study found it cost LLMs 38% more tokens. The reason: model training distribution beats format size.
OpenAI's GPT-5.5 system card reports 23% better claim-level accuracy, not the 60% hallucination reduction making press rounds. Here's what actually changed.
Agent drift is how AI agents silently deviate from their goal over long tasks. Goal drift, stale context, and four more mechanisms cause it, not the model.
Retrieval provenance for AI agents isn't an audit log or a trust verdict. It's structural metadata (source, position, time, edges) agents use to plan.
AI token usage scales with knowledge base size only when the full corpus loads per query. The real variable is selective context delivery, not KB size.
We restructured Wire's MCP surface from 2 overloaded tools to 3 single-purpose ones. The counterintuitive result: adding a tool cut total calls 24%.
Vectara's 2026 benchmark shows OpenAI's flagship GPT-5.4-pro hallucinates at 8.3% while its nano variant stays at 3.1%. The reasoning-model tradeoff, explained.
Native Notion and Obsidian MCP give every connected agent the same coarse scope. Build a private AI second brain with per-agent, revocable access across tools.
RAG vs fine-tuning: RAG wins for knowledge injection and freshness, fine-tuning wins for style and format. The right choice is a context engineering call.
A practical guide to context budgets for AI agents. How to allocate tokens across system prompts, tools, retrieval, history, and a buffer in production.