~/llamay $ head -c 4000 README.md > build/demo/work/calib.txt && wc -w build/demo/work/calib
.txt
     620 build/demo/work/calib.txt
~/llamay $ llamay imatrix -m testdata/azmx-tiny.gguf -f build/demo/work/calib.txt -chunks 4
-o build/demo/work/imatrix.dat
4 chunks, 2048 tokens
28 matrices, 2048 activations each
column spread: 3.3x typical, 8.4x worst (blk.3.ffn_down.weight)
  a spread near 1 means every column matters alike and calibration will not help;
  the further above 1, the more a weighted scale search has to work with
wrote build/demo/work/imatrix.dat

llamay quantize -i testdata/azmx-tiny.gguf -o out.gguf -type q4_k -imatrix build/demo/work/i
matrix.dat
~/llamay $ llamay quantize -i testdata/azmx-tiny.gguf -o build/demo/work/tiny-q4-im.gguf -ty
pe q4_k -imatrix build/demo/work/imatrix.dat
29 tensors converted, 9 left as they were
25 of them are Q4_0 rather than Q4_K: their rows are not a multiple of 256
2.38 MiB -> 346.64 KiB (14.2% of the original) in 43ms