Interesting things, the "effort" is an instruction telling the model how to behave, medium doesn't have anything (at least on the version of q3827 that I have) so you can set whatever you like.
These are the defaults
low: "Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration."
xhigh: "Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer."
medium: nothing is set here... in the template above I set the instruction to: "Reasoning effort is set to medium. Think through the main considerations and verify the key steps, but do not be exhaustive: once the essentials check out, commit to the answer." and I like the resulting behavior.
If you wondered what happens if you tell the model to answer like a commedian, stop wondering and start experiment.
xlayn•27m ago
If you use a gguf, you can extract the template from the Qwen3.827B model using the following script https://github.com/alainnothere/llama.cpp/blob/disk-cache-ev..., use it like
ggufGetTemplate.py MODEL.gguf [OUT.jinja]
modify the template to your liking, and then use https://github.com/alainnothere/llama.cpp/blob/disk-cache-ev... to push it into the gguf.
ggufSetTemplate.py MODEL.gguf TEMPLATE.jinja [OUT.gguf]
This one https://github.com/alainnothere/llama.cpp/blob/disk-cache-ev... has the default effort set to medium, so you can just push it into your gguf and use it.
Interesting things, the "effort" is an instruction telling the model how to behave, medium doesn't have anything (at least on the version of q3827 that I have) so you can set whatever you like.
These are the defaults
low: "Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration."
xhigh: "Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer."
medium: nothing is set here... in the template above I set the instruction to: "Reasoning effort is set to medium. Think through the main considerations and verify the key steps, but do not be exhaustive: once the essentials check out, commit to the answer." and I like the resulting behavior.
If you wondered what happens if you tell the model to answer like a commedian, stop wondering and start experiment.
Here are the results of togling the effort per message (you have to use my version of llama.cpp in the link to try that) you can see it here: https://github.com/alainnothere/llama.cpp/blob/disk-cache-ev...
Happy hacking.