Which is likely what all the VC, hype machine, and overinflated claims are really about anyways.
The tech etc is easily replicated. The hype / name, not.
I seem to remember reading that the Jev-founder-guy is ex-OpenAI anyways. So that's how these things often roll.
Why build codex if AGI will replace SWEs?
Why build excel integrations if AGI will replace spreadsheets?
vLLM has a PR very close to merging: https://github.com/vllm-project/vllm/pull/57250
Kev is an open Jev: https://github.com/jaredpalmer/kev
For now. Any company that grows to OpenAI/Anthropic's size and gets VC money is ought to become greedy.
> My main assumption is that Jev is using something quite close to a conventional large language model. As evidence of this, Latent Space reports that many of the early clones are indeed LLM-based.
Not proof that this is the case with Jev though. It might use non causal text encoder for the state, which could make sense given that its very good for its price.
Fed Claude an api key from typesafe and a link to documentation, and within about 10 minutes I had a view of HN that was populated with a little ranking as to sloppiness of each comment.
When your mind has been wired a bit to LLM latency, it feels extremely fast, and for such a subjective rating I think it did a good job.
Feels like it sits in a space between traditional ML classification and the frontier models. I can't think of a 'real' production use case for it in my sphere of influence, but certainly some will. And of course there will be five Jev competitors by the end of the year.
Is it? If AGI is here then by the time I test and deploy that the AGI will be most likely cheaper and smarter because it improved itself (for example by implementing it's own Jev for stupid prompts like this), so why invest into a more complex solutions?
> so why invest into a more complex solutions
The are many automation pipelines that use LLMs because there was no choice, but the multi-way classification that Jev provides is exactly what they need, and is going to be way faster and cheaper, as well as having the benefit of calibrated probabilities and structured output that can be relied on.
tolugenius•39m ago
mnicky•37m ago
Or they can even offer it as a standalone API if deemed worth it.
HarHarVeryFunny•22m ago
1) It's very cheap and fast - you provide one input and many potential classifications, and the compute to ingest the input is shared.
2) It generates structured output natively - guaranteed to be correct
3) It's output probabilities are calibrated to actually mean something
OpenAI, or anyone else, could certainly replicate it - there are already articles guessing how Jev achieves its "parallel" classifications, but it seems the AI companies need to decide are they in the business of providing intelligence/tokens, or are they in the application business trying to compete with all their customers (not that Jev uses OpenAI).
verdverm•18m ago
alex_sf•17m ago
> 2) It generates structured output natively - guaranteed to be correct
It's not guaranteed to be correct: it's guaranteed to be _formatted in a particular way_. You can get the same thing with grammars on any LLM.
Jev and Jev-like models have other advantages, but I feel like people forget grammars exist for LLMs.
time0ut•3m ago
robertclaus•28m ago