Module fetch 

Model fetch: download, resume, and verify before use.

Re-exports

use std::collections::HashMap; 🔒

use std::fs; 🔒

use std::fs::File; 🔒

use std::ops::ControlFlow; 🔒

use std::path::Path; 🔒

use std::path::PathBuf; 🔒

use std::sync::mpsc; 🔒

use std::sync::Mutex; 🔒

use std::sync::PoisonError; 🔒

use sha2::Digest; 🔒

use sha2::Sha256; 🔒

use crate::Config; 🔒

use crate::Error; 🔒

use crate::ModelSpec; 🔒

Structs

CacheInner 🔒

DigestCache 🔒

Remembers which digest each model file had when it was last verified, so a file that has not changed since is not read end to end again.

DigestFile 🔒

DigestRecord 🔒

What one file’s last verification saw.

HashingWriter 🔒

Feeds bytes into the digest and checkpoints cancellation every interval bytes, so a cancel during verification does not wait out the whole hash.

ProgressWriter 🔒

Counts bytes on their way to disk and forwards the running total, rate-limited so a multi-gigabyte transfer does not call back once per read.

Report 🔒

One model thread’s progress event and the channel its verdict comes back on.

Enums

Progress

What prepare reports as it works.

Constants

DIGEST_CACHE_FILE 🔒

The record of verified digests inside Config::digest_cache_dir.

DIGEST_CACHE_VERSION 🔒

The record’s own version. A file written by a layout this build does not know is ignored rather than misread.

PROGRESS_INTERVAL 🔒

Bytes between progress reports during a transfer.

VERIFY_PROGRESS_INTERVAL 🔒

Bytes between cancellation checkpoints while hashing. Coarse, since a checkpoint round-trips the prepare driver: at hashing speed this keeps cancel latency near 120 ms without an event per read.

Functions

announce 🔒

Hand one progress event to the caller, turning a Break into the error that unwinds the whole operation.

check_present 🔒

Check a model already on disk, verifying it unless its record says it has not changed since the last check.

content_range_starts_at 🔒

Parse Content-Range: bytes <start>-<end>/<total> and say whether the body starts where the caller asked. A missing or unreadable header counts as no, which costs a restart rather than a splice.

discard_unusable_partial 🔒

Decide what a failed partial deserves, and say so in the log.

download 🔒

ensure 🔒

is_bytes_verdict 🔒

Whether a failure is a verdict on the BYTES rather than on reaching or reading them. Only a verdict on the bytes is a download’s to settle: an io error says nothing about them, and a fetch cannot answer it.

models_dir 🔒

The configured directory, else a subdirectory of the platform cache directory. Never derived from the working directory: a caller with no usable cache directory gets an error to act on.

prepare

Make every model the config names present and verified.

sha256 🔒

state_of 🔒

The state a record is keyed on: length and modification time. None when the file cannot be stat’ed, which leaves the caller to report whatever is wrong with it.

verify 🔒

Check path against the spec, hashing only what there is a digest for.

Type Aliases

Reporter 🔒

The caller’s progress callback as the internals pass it around.