Skip to main content

draft

Function draft 

Source
pub fn draft<'a>(
    source: &'a [LlamaToken],
    generated: &[LlamaToken],
    ngram: usize,
    k: usize,
) -> &'a [LlamaToken]
Expand description

The tokens following the most recent occurrence of generated’s last ngram tokens within source, capped at k.

Most recent rather than first: the nearest match is the better predictor when a phrase repeats.