TypeSafe · Early Access

Evaluate text at scale with Jev.

Jev is a structured judgment model by TypeSafe. It outputs exact booleans, choices, and scores. You can process up to 32 independent questions in parallel per request.

Illustration of Jev turning a block of text into three structured judgment cards: a probability bar, a multiple-choice selector, and an ordered score bar

Call Jev directly from your workspace.

The Kollab Agent invokes Jev automatically when you ask for structured evaluations. You can also run it manually via the CLI for scripts and pipelines.

Install & call it
npm install -g @kollab/cli
kollab login

echo '{
  "state": "Help! My payouts have been failing for 3 days.",
  "questions": {
    "is_urgent": { "type": "noul", "instructions": "Does this convey urgency?" },
    "department": { "type": "choice", "instructions": "Which team should handle this?",
      "criteria": { "billing": "Payments, invoicing, refunds", "technical": "Bugs, outages, integrations", "sales": "Pricing, upgrades, new accounts" } }
  }
}' | kollab tool run jev --json

Part of the Kollab model armory.

Access Jev alongside a complete suite of models for text, vision, video, and audio tasks.

Images
GPT Image 2
Video
Seedance 2 · Veo 3
Voice
Grok TTS · Grok STT
Vision
Visual Q&A
Search & data
Web search · Deep search · Social data fetch
Chat models
Claude · GPT · Gemini · Grok · Kimi · DeepSeek · GLM

Structured judgment use cases.

Run specific evaluation tasks with Jev.

Performance benchmarks.

Fast execution and high consistency for batch classification tasks.

Official Benchmarks
Parallel vs Sequential
10x faster · 12.2x cheaper

13 questions in one call: 0.27s vs 2.71s for 13 separate calls

TypeSafe cookbook
Official Benchmarks
Candidate Reranking Top-10 Accuracy
38% → 62%

CLERC legal dataset, 40 queries, BM25 top-30 shortlist

TypeSafe cookbook
Independent Evaluations
Agreement with Claude Fable 5.1
91.5%

6,003 ratings checked · $160 vs $33,000 per million judgments

Good Start Labs
Independent Evaluations
Writing Defect Detection Speed
25x faster

0.35s median vs 8.83s · detected 6/7 seeded defects

Every.to
Independent Evaluations
Spam Zero-Shot Classification Accuracy
98.64%

5,733-email test set, close to a tuned TF-IDF baseline's 98.87%

bitnovus (independent)

Frequently asked questions.

What is Jev and how does it differ from standard chat models?+

Jev is a structured judgment model. It outputs exact booleans, choices, and scores. It skips conversational text entirely and returns pure data.

How do I use Jev in Kollab?+

The Kollab Agent invokes Jev automatically when you describe a task requiring structured judgment. You can also call it directly from your terminal using the `kollab tool run jev` command.

How is the pricing calculated?+

Input tokens cost $0.042 per million. Output tokens are completely free.

Does Jev support Chinese, Japanese, and Korean?+

Yes. The accuracy for CJK languages is currently lower than English.

Are the confidence probabilities absolutely accurate?+

Independent audits show Jev's output probabilities are not strictly calibrated. Treat them as relative, monotonic scores. We recommend spot-checking high-risk tasks.

Can Jev process images or audio?+

Jev only processes plain text up to 80,000 characters. You must transcribe audio or extract text from images first. Kollab provides other models like GPT Image 2 and Grok STT for direct media processing.

Start evaluating text with Jev.

Run high-volume classification and scoring tasks directly in your workspace.