Skip to main content

Module bench

Module bench 

Source
Expand description

Benching a model on this machine’s own material: which models a run can load, the config each one runs under, and the state and results the page reads.

The corpus and the runner are forge-dictate’s; this module is the workspace’s half - it knows the roles, the installed set and the store.

Re-exports§

use std::path::Path; 🔒
use std::sync::Arc; 🔒
use std::sync::atomic::Ordering; 🔒
use forge_dictate::ModelSpec; 🔒
use crate::dictate::SetRecording; 🔒
use crate::DispatchError; 🔒
use crate::Workspace; 🔒

Structs§

BenchResult
What one finished bench measured, kept under what it was about.
BenchTarget
One model a bench can load.
LiveRoles
What the live roles run on this machine, for a bench that runs outside forge.
ReadAloudRecording
One recording of the read-aloud passage, as the page lists it: what the row draws and what the bench scores, one row per clip.
ReadAloudState
The read-aloud set as the page reads it: the recordings this machine has, whether one is being recorded right now, the passage they are read from, the terms a run scores them on, and the last recording’s failure when there is one - a write that failed after the stop has no dispatch left to answer, so the read carries it.
SpeakingBenchResult
What one speaking bench measured, kept under the model and corpus it ran.
StoreCopy 🔒
A copy of a store another process holds, removed when it goes.

Enums§

BenchRole
Which slot a bench target runs in, in the names the wire uses.
BenchState
Where the last bench got to, as the page draws it.
SpeakingBenchState
Where the speaking bench got to, as the page draws it.

Constants§

RESULTS_SHOWN 🔒
How many saved results the page reads.

Functions§

config_for
The config one target runs under: the base with the target’s file in its role’s slot.
read_aloud_recordings 🔒
The set directory’s recordings, oldest first, read off the take directories themselves: the name carries the stamp, meta.json the length the recorder wrote, and the wav its size and its own sha. A directory without its meta is one the store was interrupted writing, and is skipped rather than listed as a clip the bench would then skip too.
resolved_live_roles
The models the live roles resolve to, read by a process that is not forge.