Performance
Tokens per second, memory, quantisation and context length, measured on real hardware, and how to get more from what you have.
Tokens per second, memory, quantisation and context length, measured on real hardware, and how to get more from what you have.