x.com
Vincent.seo on X: Jev 가 우리 로직을 대체할 수 있을까요?
@xunaoo@xunaoolisted 47m agoreviewed by JevJev 가 우리 로직을 대체할 수 있을까요? 아닙니다. 대체가 아니라 로직 안으로 들어앉습니다. 제 브라우저 에이전트에 붙여 봤습니다. 판단 한 단계가 2초에서 0.2초, 모델 호출이 열 번에서 두 번. 그런데 정확도는 6%p 낮습니다. ❤️ 1 likes on X
- Author
- @xunaoo
- Use case
- Benchmarks & Evals
- Added
- 2026-09-25
All figures come from the author. Check the source before you quote them.
More in Benchmarks & Evals
- Morgan on X: It has been a really interesting experience to build an eval suite for System On▲ 0x.com
- silentguy on X: Grok Bot does the job, Jev decides where the job goes next▲ 0x.com
- spect on X: The founder of Jev just dropped a 1-hour masterclass on how Jev actually works▲ 0x.com
- Dain on X: A beautiful pattern can still be noise.▲ 0x.com
- Utkarsh Maheshwari on X: Is the Jev hype real,▲ 0x.com
- OpenMed on X: Four typed questions across four authored fictional notes, labels written before▲ 0x.com
Jev guides for this use case
- Using Jev as a judge for evalsGrading with a decision model instead of a prose-writing judge, and why calibrated confidence is the real prize.
- How Jev sorts a build into one of 21 use casesThe 21 criteria Jev classifies against, published in full, plus what the reviewer sees and how ambiguity is handled.
- Jev statistics: latency, cost, and this directory's own numbersPublished benchmarks with their caveat attached, plus live directory figures that update automatically.
Bid history
No bids yet — the first one takes this project straight to the spotlight.