SpecCompact: Accelerating LLM Agent Context Compaction with Slot-Parallel Semantic Speculative Verification
LLM agents use context compaction to manage growing interaction histories, but summarizing long histories with large models can introduce substantial delays.
The arXiv Language-Model Research page documents the arXiv update.
