quantgap

Qwen3-0.6B

pack Qwen3-0.6B@282f68b573fc832a (id 282f68b573fc832a), 2 result(s). Lower KLD is better. Click a column to sort.

KLD mean against file size. Bars are 95% intervals. Lower and further left is better.
QuantPublisherSizeKLD mean95% intervalWorst 1%Top-1PPL ratioLoops (q/ref)Wrong scriptJSON okBackend
Q3_K_Mtensorblock414.0 MB0.39530.3803 to 0.41043.01769.8%1.45535/3202/8llamacpp
Q2_Ktensorblock347.3 MB2.45542.3736 to 2.543110.48433.8%11.01948/3200/8llamacpp

approx = the server only reported its own top-N, so some reference tokens were counted in the tail bucket. nd = the same text gave slightly different numbers on two runs. "Loops" shows quant / original. All results used the same probe set and pack.