ILLATIO ECOSYSTEM // SPARSE MOE INFERENCE INFRASTRUCTURE GUILD CORE 140F6F7
Guild Docs.
Menu
GitHub
Start here / 140f6f7

Web guide · derived from pinned Core sources

On this page

The Guild command line

Run guild --help from your built binary for its authoritative command surface. These commands are listed in the pinned README:

CommandPurpose
guild pull <model>Download a registry model
guild import <path>Import an existing local model
guild listList installed models
guild show <model>Inspect a model in the store
guild run <model>Run interactively
guild serve <model>Start the native OpenAI-compatible server
guild bench <model>Benchmark a model
guild psShow running model processes

Containers and optimization

The GEXEC contract describes the machine-specific optimizer:

guild optimize model.gpack --mode auto -o model.gexec
guild inspect model.gexec --plan
guild run model.gpack --gexec model.gexec

model.gpack is your actual local portable model container. GEXEC is an execution cache, not a replacement for its source weights. Missing or incompatible GEXEC data falls back to portable execution with a logged reason.

Decode strategies

guild run <model> --decode-strategy adaptive --spec-max-draft 4

The scheduler can choose normal, mtp, lookup, and retrieval when eligible. MTP requires the appropriate draft weights. Lookup proposes continuations from token history; retrieval uses a bounded session-local store. Every proposal is verified by the target model.

Legacy --spec and strategy-specific options are documented in the pinned adaptive decoding report. Sampling parity across Qwen verification-window sizes in that report uses GUILD_IQ_MT_MIN=1 to align CPU reduction behavior.