Expand description
Repairs raw speech-recognition output into written text.
Punctuation, capitalization, filler removal, spoken numbers and dates rendered in written form, and self-corrections resolved to whatever the speaker landed on. Text in, text out: this stage never sees audio.
The model is “S1-mini” by “Superwhisper”, 596M parameters, Apache 2.0 plus a clause requiring it to keep that name and capitalization wherever it is used. llama.cpp reports 751632384 because the tied embedding is stored materialized and counted twice.
§The model card describes intent, not measured behaviour
Every behavioural claim in it that has been tested here has failed to
reproduce: omitting the empty think block returns a <think> fragment
rather than nothing, formal is not semi-formal plus expanded
contractions, and the card’s own three-item lists example comes back
as prose. The input FORMAT it documents is exact and worth following to
the byte; its statements about what the model will do are not. Run the
claim before building on it.
Re-exports§
pub use prompt::Context;pub use prompt::Structure;pub use prompt::Styling;use std::io::Read as _;🔒use std::io::Seek as _;🔒use std::num::NonZeroU32;🔒use std::path::Path;🔒use std::path::PathBuf;🔒use std::sync::OnceLock;🔒use llama_cpp_2::context::params::LlamaContextParams;🔒use llama_cpp_2::llama_backend::LlamaBackend;🔒use llama_cpp_2::llama_batch::LlamaBatch;🔒use llama_cpp_2::model::LlamaModel;🔒use llama_cpp_2::model::params::LlamaModelParams;🔒use llama_cpp_2::LogOptions;🔒use llama_cpp_2::send_logs_to_tracing;🔒
Modules§
Structs§
- Normalize
Options - Per-call settings.
Defaultis what ships, so a caller that does not care constructs it without naming an axis. - Normalizer
- A loaded normalizer. Holds the weights; cheap to call repeatedly.
- Plan 🔒
- How much room one call needs.
- Session 🔒
- A decoded prompt, ready to generate from.
Enums§
- Normalize
Error - Everything the normalizer can fail with.
Constants§
- CAUSAL_
ARCHS - The architectures this stage’s generator can run: llama.cpp’s causal text models.
- GGUF_
STRING 🔒 - The format’s own type tag for a string value.
- GPU_
LAYERS 🔒 - Offload everything; llama.cpp clamps this to the layers that exist and silently does nothing without an accelerated backend compiled in.
Functions§
- architecture 🔒
- The architecture a gguf declares, read from the file’s own header.
- backend 🔒
- llama.cpp’s backend is global to the process and may be initialized exactly once.
- decode_
piece 🔒 - Decode one token’s bytes through a decoder the whole generation reuses. The decoder must persist across tokens: a piece can end mid-character, and a fresh decoder would replace both halves.
- plan 🔒
- The card’s ceiling is 1.3x the input plus 32, taken over the whole prompt rather than the transcript, so it sits looser than the figure it comes from.
- read_
string 🔒 - One length-prefixed utf-8 value, bounded so a corrupt length cannot ask for an allocation nobody has.
- read_
u32 🔒 - read_
u64 🔒 - skip_
value 🔒 - Step over one metadata value, by the format’s own type table. Anything the table does not name ends the walk, which the caller answers with the same refusal as a malformed header.