'It's just autocorrect', engineering version
1. Creativity = Effectiveness × Novelty, all ranging from 0 to 1
2. In LLM outputs, effectiveness/novelty are negatively correlated (higher-scored continuations have higher effectiveness but lower novelty, and vice versa)
3. "the negative correlation of E[ffectiveness] and N[ovelty] means that Novelty [...] can be expressed as one minus the Effectiveness"
4. So the creatvitiy equation becomes Creativity = Effectiveness × (1 - Effectiveness), which maxes out at 0.25 creativity
5. 0.25 creativity corresponds to the boundary between amateur and professional creativity ("the 4Cs representation of creativity")
But just because there's a negative correlation between E and N does not mean that N = 1 - E. The exact correlation wouldn't matter if these were just arbitrary units with no defined scale or zero-point, but the conclusion rests on referencing "0.25 creativity" against an existing scale to determine its meaning. That there's a negative correlation/trade-off between the two (straying from well-established solutions increases risk of failure) doesn't seem unique to LLMs.
MrCoffee7•2mo ago
metalman•2mo ago