~/llamay $ # a 0.5B model, asked for structure, with nothing enforcing it ~/llamay $ llamay run -m qwen2.5:0.5b -chat -n 90 -p "Give me a JSON object with keys name, port and tls for a local server." Certainly! Below is a JSON object containing the specified keys: ```json { "name": "localServer", "port": "8080", "tls": "true" } ``` This object defines a local server with the following properties: - `name`: The name of the server (e.g., "localServer"). - `port`: The port on which the server will listen (e.g., `8 prompt 25 tokens in 175ms (142.5 tok/s) · generated 90 in 7.357s (12.2 tok/s) · stop: length ~/llamay $ # the same request with -json: the sampler cannot emit an invalid token ~/llamay $ llamay run -m qwen2.5:0.5b -chat -json -n 90 -p "Give me a JSON object with keys name, port and tls for a local server." { "name": "Local server", "port": 8080, "tls": true } prompt 25 tokens in 199ms (125.7 tok/s) · generated 26 in 1.668s (15.6 tok/s) · stop: eog json mask: 27 steps, 11.97 ms each, 19.4% of decode · no mask cache in this automaton ~/llamay $ llamay run -m qwen2.5:0.5b -chat -json -n 90 -p "Give me a JSON object with keys name, port and tls for a local server." | jq . prompt 25 tokens in 172ms (145.3 tok/s) · generated 26 in 1.473s (17.7 tok/s) · stop: eog json mask: 27 steps, 11.10 ms each, 20.4% of decode · no mask cache in this automaton { "name": "Local server", "port": 8080, "tls": true }