14 points | by chatchan 3 hours ago ago
1 comments
What about cache? When you change the context the prefill stage will be much slower?
What about cache? When you change the context the prefill stage will be much slower?