Skip to main content

GPU_LAYERS

Constant GPU_LAYERS 

Source
const GPU_LAYERS: u32 = 999;
Expand description

Offload everything; llama.cpp clamps this to the layers that exist and silently does nothing without an accelerated backend compiled in.