struct Session<'a> {
ctx: LlamaContext<'a>,
batch: LlamaBatch<'a>,
start: i32,
budget: usize,
}Expand description
A decoded prompt, ready to generate from.
Fields§
§ctx: LlamaContext<'a>§batch: LlamaBatch<'a>§start: i32§budget: usizeAuto Trait Implementations§
impl<'a> !RefUnwindSafe for Session<'a>
impl<'a> !Sync for Session<'a>
impl<'a> Freeze for Session<'a>
impl<'a> Send for Session<'a>
impl<'a> Unpin for Session<'a>
impl<'a> UnsafeUnpin for Session<'a>
impl<'a> UnwindSafe for Session<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more