Configuration examples

Replace each example candidate model with a healthy, routable resource from your console; choose client-facing model names independently. Saving a configuration synchronously updates its Lumoswitch Runtime deployment group and Virtual Keys.

Fixed: testing and consistency

Name: support-test
Mode: Fixed
Model: Qwen / qwen-plus
Client-facing model name: support-test

Lumoswitch Runtime sends every request to one model and returns its upstream error directly. Use this for evaluation, prompt testing, or version-pinned behavior.

Failover: production availability

Name: support-prod
Mode: Failover
Candidates: Qwen / qwen-plus -> DeepSeek / deepseek-chat -> OpenAI / gpt-4o-mini
Client-facing model name: support-prod

Candidate order is priority, not round robin. Lumoswitch Runtime advances to the next deployment when the current candidate fails. Verify request shape, tools, streaming, and output quality against every fallback before launch.

Auto routing: complexity-based model selection

Name: assistant-auto
Mode: Auto routing
Candidates: lightweight model -> general model -> reasoning model
Client-facing model name: assistant

Lumoswitch deterministically maps the ordered candidates onto Lumoswitch Runtime's SIMPLE, MEDIUM, COMPLEX, and REASONING tiers. Two or three candidates are valid and adjacent tiers reuse a model. Order by capability from lightest to strongest, not by failover priority.

Least busy: concurrent throughput

Name: batch-throughput
Mode: Least busy
Candidates: two or more interchangeable model resources

Lumoswitch Runtime selects the candidate with the fewest active requests. Candidates should have compatible interfaces and quality because list order is not priority.

Lowest latency: interactive response

Name: chat-low-latency
Mode: Lowest latency
Candidates: two or more interchangeable model resources

Lumoswitch Runtime selects from observed response latency. Warm a new configuration with realistic non-production requests, then monitor latency across request types, regions, and streaming modes.

Multiple client-facing model mappings

Configuration: support-prod
Client-facing model name: support-prod -> Whole configuration (full failover)
Client-facing model name: support-primary -> Qwen / qwen-plus (direct candidate)

One configuration can expose multiple model names. A name targeting the whole configuration uses the complete routing policy. A name targeting one candidate bypasses configuration-level routing; it is useful for testing or explicit selection but does not provide configuration-level availability or load balancing.

Separate test and production

Create distinct configurations and Access Keys for each environment. After changing candidates or client-facing model mappings, wait for the configuration to report ready and send a minimal request to the Lumoswitch inference endpoint immediately.