[03:52:17] <wikibugs>	 06Machine-Learning-Team: [LLM] ML-lab benchmarking - https://phabricator.wikimedia.org/T382343#10419920 (10achou) **llmperf**  Below are the results from llmperf benchmarking for aya-expanse-8b and 32b original and quantized models (AWQ, Bitsandbytes, and GPTQ):  * aya-expanse-8b {F58035638}  * aya-expanse-32b {...
[04:35:50] <wikibugs>	 06Machine-Learning-Team: [LLM] ML-lab benchmarking - https://phabricator.wikimedia.org/T382343#10419936 (10achou)