KV cache

SparseEngine: An Inference Engine That Prioritizes Sparsity

SparseEngine unifies 15 sparse KV-cache methods for long-context LLM agents, adds Chain Cache and prefix pruni…