Skip to main content

quant_of

Function quant_of 

Source
fn quant_of(name: &str) -> Option<String>
Expand description

The quant a file name spells, when it spells one this runtime loads.

Matched on a token boundary, longest first, because BF16 contains F16: a substring search labels a BF16 file F16, and the download behind it would then be asked for a quantisation the repo does not carry.