People are cynically shitting on Jev, but I think it is a work of genius
The fact is that a decoder-only LLM is overkill and even actively undesirable for many tasks within a computer program where you need an intelligent decision, whereas an intelligent decision model like Jev is exactly what you need
For example, in Theus, our company’s enterprise knowledge management system, we need to know whether a fact is scientific evidence, a study detail, or a business constraint
Sure, an LLM could tell us this, and Gemini does have strong structured output capability, but it is more than we need, so calling one wastes time and money
Jev, on the other hand, can provide us with these decisions almost instantly and almost for free
I think you’re going to see more and more calls to Jev greasing the wheels inside software as more and more people realize what has actually been provided here
If you aren’t using Jev, I encourage you to play around with it and to think about how you can use it within the programs that you’re writing
It is really almost magical