jev is the new thing everyone is building jevs so obviously I wanted my own technically, a jev skips the whole token-by-token generation thing it reads the logits straight from prefill and picks from there which is kinda cool because you can cache the prompt once and run a bunch of questions in parallel

...anyway, I built one you can try it here ↓ github.com/mpuig/system-one