~/llamay $ # a prompt that repeats itself, which is what an edited document looks like ~/llamay $ wc -c build/demo/work/repeat.txt 1464 build/demo/work/repeat.txt ~/llamay $ # first the case it is for: the answer quotes the prompt back ~/llamay $ llamay run -m qwen2.5:0.5b -n 96 -stats -p "$(cat build/demo/work/repeat.txt) > Repeat the paragraph above, word for word:" The quarterly report states that revenue grew by 14 percent. The quarterly report states th at revenue grew by 14 percent. The quarterly report states that revenue grew by 14 percent. The quarterly report states that revenue grew by 14 percent. The quarterly report states tha t revenue grew by 14 percent. The quarterly report states that revenue grew by 14 percent. T he quarterly report states that revenue grew by 14 percent. The quarterly report states that prompt 322 tokens in 2.323s (138.6 tok/s) · generated 96 in 7.991s (12.0 tok/s) · stop: leng th ~/llamay $ llamay run -m qwen2.5:0.5b -lookup -n 96 -p "$(cat build/demo/work/repeat.txt) > Repeat the paragraph above, word for word:" The quarterly report states that revenue grew by 14 percent. The quarterly report states th at revenue grew by 14 percent. The quarterly report states that revenue grew by 14 percent. The quarterly report states that revenue grew by 14 percent. The quarterly report states tha t revenue grew by 14 percent. The quarterly report states that revenue grew by 14 percent. T he quarterly report states that revenue grew by 14 percent. The quarterly report states that prompt 322 tokens in 2.102s (153.2 tok/s) · generated 96 in 5.083s (18.9 tok/s) draft ngram · 96 tokens in 15 passes (6.40x) · 81/88 drafts accepted (92%) · 6.40 tokens per target pass · lookahead 8 ~/llamay $ # now the case it is not for: a summary shares almost nothing with the prompt ~/llamay $ llamay run -m qwen2.5:0.5b -lookup -n 96 -p "$(cat build/demo/work/repeat.txt) > Summarise:" What is the answer to the question where is the word "growth" in the context of the sentenc e? The sentence is about a company's growth in revenue. The word "growth" in the context of the sentence is used to describe the company's increase in revenue over a certain period. Sp ecifically, the sentence states that the company's revenue grew by 14 percent. The word "gro wth" is used in this context to indicate that the company's revenue has increased in value prompt 317 tokens in 2.302s (137.7 tok/s) · generated 96 in 8.052s (11.9 tok/s) draft ngram · 96 tokens in 79 passes (1.22x) · 17/38 drafts accepted (45%) · 1.22 tokens per target pass · lookahead 8 ~/llamay $ # the acceptance rate in the last line is the whole story — it is what decides wh ether drafting is free or wasted