config.toml used by izwi serve. server.host and server.port configure izwi serve only; other commands connect to --server (default http://localhost:8080).
Synopsis
Subcommands
Supported Keys
izwi config set and izwi config get support these keys:
server.hostserver.portserver.corsserver.cors_originsmodels.dirruntime.backendruntime.max_batch_sizeruntime.physical_execution_moderuntime.max_physical_in_flightruntime.max_scheduler_batch_sizeruntime.max_loaded_modelsruntime.model_keep_alive_secsruntime.enable_prefix_cachingruntime.prefix_reuse_catalog_autoruntime.managed_prefix_cache_saltruntime.max_prefix_cache_pagesruntime.enable_chunked_prefillruntime.chunked_prefill_thresholdruntime.max_retained_sequencesruntime.max_staged_transactionsruntime.max_queued_requestsruntime.max_sequence_lengthruntime.threadsruntime.max_concurrentruntime.timeoutui.enabledui.dirruntime.performance.cuda.*:mode,projection_backend,packed_projections,fused_decode,device_sampling,decode_graphs,mtp,mtp_quantum,mtp_draft_tokens,mtp_adaptive,mtp_in_continuousruntime.performance.loading.*:mode,derived_weight_cache,parallel_conversion,pinned_uploads,io_strategy,workers,max_staging_bytes,cache_max_bytes,cache_dirruntime.performance.metal.projection_backendruntime.performance.cpu.projection_backend
izwi config set
Set a configuration value.server.cors_origins accepts either a comma-separated list or a TOML array literal.
izwi config get
Get a specific configuration value.izwi config get prints the built-in default.
izwi config show
Display the current configuration file.show prints the default template instead.
izwi config edit
Open the configuration file in your default editor.$EDITOR, or falls back to vi.
izwi config reset
Remove the configuration file.Options
izwi config path
Show the configuration file path.Configuration File
The config file is TOML:izwi serve resolves runtime values in this order:
- CLI flags
- Environment variables
config.toml- Built-in defaults
File Locations
See Also
izwi serve— Server options and runtime precedence