JSON mode changes what your model answers
Across 44 language models, asking for JSON collapsed answer diversity: distinct answers fell from 52 to 36 and the top answer rose from 41% to 64% of responses.
Blog
Practical context engineering for AI agents: how to structure, deliver, and manage the context that determines whether AI systems actually work.
Research-backed articles on context architecture, retrieval, agent security, and making AI tools more effective. Written by Jitpal Kocher.
Across 44 language models, asking for JSON collapsed answer diversity: distinct answers fell from 52 to 36 and the top answer rose from 41% to 64% of responses.
Kimi K3's 1M-token window runs on Kimi Delta Attention: hybrid linear attention with a fixed-size state. Why cheap long context still needs context curation.
GPT-5.6 Sol's Ultra mode gives each subagent its own context window. It solves context isolation but not handoff, and it multiplies your token bill fast.
AI agent reliability fails because the same task assembles different context every run. Non-determinism is a context engineering problem, not a model flaw.
Context pruning helps AI agents in one regime and hurts in another. A 2026 study of models from 4B to 284B maps when to prune stale context and when not to.
Knowledge graphs vs RAG: graph retrieval wins multi-hop reasoning and global summarization, but vector RAG matches it on simple lookups at far lower cost.
Context bloat is when accumulated tool-call output crowds out an agent's task. Tool calls, not window size, break long-running agents. Here is the fix.
Chunking strategies decide which context reaches your AI. How fixed-size, semantic, and late chunking change retrieval accuracy, with 2026 benchmark data.
Agent context management is shifting from fixed harness rules to learned, runtime decisions an agent makes about its own window. What the 2026 research shows.
A 2026 systems paper found 21.8% of tokens in agent context windows are wasted. Demand paging treats the AI context window as L1 cache, not full memory.