CLI command
probierz figure-evaluate
Render a reference and candidate figure deterministically, then obtain a rubric-scored vision verdict through the authenticated Stado model router.
Invocation#
probierz figure-evaluate --reference <REFERENCE> --candidate <CANDIDATE>Required inputs and options#
- `--reference` and `--candidate` are required supported SVG, TeX, PDF, or image files.
- The model comes from `--model` or `PROBIERZ_FIGURE_VISION_MODEL`; router URL/token may come from flags, stdin, or the documented environment.
- `--router-token-stdin` reads the bearer from stdin line 1 and optional agent secret from line 2.
Output and state effects#
Creates deterministic renders and a JSON report containing dimensions, evidence, blockers, fidelity losses, recommendations, and `verdict.pass`. A non-passing verdict sets exit code 1.
Exact refusals#
- Missing required paths: `figure-evaluate needs --reference` or `figure-evaluate needs --candidate`; unknown, repeated, or valueless options are refused.
- Inputs must exist with supported types; output must end in `.json` and no report/render output may already exist.
- The router URL, bearer, selected model, rubric, render tools, and returned model evaluation are all validated; invalid or incomplete values are refused.
Source snapshot#
Generated from the Rust binaries at https://github.com/wisent-ai/probierz.git revision `f40fa7ed94a028b56b5a59342eaf55982ba5cf7d`.
Combined help SHA-256: `04bab0ac1e9691119efcb70627b534a73431f51bb44ed8ba81d93cc10afd6569`; binary SHA-256: `08424ee2465261eafaa112d13ef05a20ce1fe1b6479e896341e22fbc55e61d3e`.