Interesting: "Reviews are billed on token usage and generally average $15–25, scaling with PR size and complexity."
karmakaze•1h ago
At those prices I wonder if it also reviews the design for ineffectiveness in performance or decomposition into maintainable units besides catching the bugs.
Also the examples are weird IMO. Unless it was an edge/corner case the authentication bug would be caught in even a smoke test. And for the ZFS encryption refactor I'd expect a static-typed language to catch type errors unless they're casting from `void*` or something. Seems like they picked examples by how important/newsworthy the areas were than the technicality of the finds.
cbovis•25m ago
This cost seems wild. For comparison GitHub Copilot Code Review is four cents per review once you're outside of the credits included with your subscription.
simianwords•1h ago
nice but why is this not a system prompt? what's the value add here?
NoahZuniga•39m ago
You're paying the same token rate for this as you would if it was just a system prompt. Clearly the scaffolding adds something.
(They mention their github action which seems more like a system prompt)
simianwords•35m ago
seems like a very small value add. why is this a blog post - i could do this myself.
Bnjoroge•46m ago
what are the implications for the tens of code review platforms that have recently raised on sky high valuations?
satvikpendem•35m ago
Same as all the other companies that built on top of the API and then were obsoleted after the API provider made it a built-in feature.
CharlesW•1h ago
karmakaze•1h ago
Also the examples are weird IMO. Unless it was an edge/corner case the authentication bug would be caught in even a smoke test. And for the ZFS encryption refactor I'd expect a static-typed language to catch type errors unless they're casting from `void*` or something. Seems like they picked examples by how important/newsworthy the areas were than the technicality of the finds.
cbovis•25m ago