Looking solely at AA's intelligence index, recognizing the pitfalls with using that as a measure- Luna 6 Max > Terra 6.1 Low is 51.3% cheaper, 94.1% less output tokens, for 1.56 higher index score.
What happened to zuck? Was the metaverse this destructive?
(*) Feeling charitable today
Treating the refusal as a 0 score erases the difference between lack of capability and a lack of willingness to perform.
simonw•32m ago
https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
There's usually a reasonably strong correlation between thinking level and visual quality of the pelican. This is the first time I've seen that correlation appear to break - more reasoning tokens doesn't seem to produce an obviously better SVG.
meric_•20m ago
sjacob•19m ago
permalac•19m ago
MadameMinty•1m ago
imimayj1337•19m ago
swatcoder•3m ago
If you look at the code for each of these (and probably most across models), you can see that the drawing elements are organized by concept. Presumably, this helps accuracy by keeping attention on one concept at a time, but you end up with a stack of conceptualized objects and lose the ability to interleave things.
No doubt these could all do better with a more thorough and specific prompt that coached them away from that technique, but otherwise it's a very subtle detail that a "thinking" process needs to stumble upon independently.
eterm•7m ago
jolt42•5m ago