Cache precision

Cache precision is how much numerical detail is kept in the Key-Value Cache (KV cache), the model’s reusable information about earlier tokens.