Lumoswitch Docs

Upstream support matrix

Lumoswitch currently includes 33 inference-channel presets. Each preset keeps the stable channel code, upstream wire protocol, and LiteLLM provider separate. It also supplies the recommended base URL and model-discovery rules. Channel permissions determine which models are visible; structured capability declarations come from the catalog and administrator overrides, never guesses from /models.

The compiler uses the explicit, reviewed LiteLLM provider prefix; it never infers one from the wire protocol. The provider prefix selects LiteLLM's request transformation and does not rename the actual channel. LiteLLM selects the default conversion behavior from the provider and model. DeepSeek and custom OpenAI-compatible channels can use native Responses after a direct probe passes and an administrator or upstream owner enables it.

Generic OpenAI-compatible channels use LiteLLM's custom_openai provider so Responses, Anthropic Messages, and Gemini requests can use LiteLLM's standard conversion path instead of being treated as native OpenAI endpoints. Xiaomi MiMo deliberately uses the openai provider because its current service exposes compatible Chat, Responses, and Anthropic APIs. MiniMax uses custom_openai with LiteLLM v1.102.0-rc.1 because that release's native minimax provider still cannot construct both the Chat and Anthropic endpoints from one deployment Base URL.

LiteLLM v1.102.0-rc.1 adds a native Responses adapter for Fireworks AI. This channel uses its own native provider, so Responses requests now default to the upstream native endpoint without the explicit switch used for DeepSeek and custom channels. The adapter does not support native WebSocket or File Search; validate HTTP Responses with the actual model during the upgrade.

Native Responses reports show separate HTTP, SSE, tool, and usage checks. A successful report remains valid while the target identity and runtime version stay unchanged, with retesting available when needed. Changes to the model, base URL, credential version, or runtime version require a new probe and manual enablement. The management page shows the saved configuration and database synchronization status: no deployment, pending, synchronized, or failed. Synchronized configuration does not establish the runtime’s current live state. The page refreshes when opened, after an action, or on manual refresh.

Mainland China and general upstreams

UpstreamProtocolDefault base URL
DeepSeekOpenAI-compatiblehttps://api.deepseek.com/v1
QwenOpenAI-compatiblehttps://dashscope.aliyuncs.com/compatible-mode/v1
GLMOpenAI-compatiblehttps://open.bigmodel.cn/api/paas/v4
KimiOpenAI-compatiblehttps://api.moonshot.cn/v1
DoubaoOpenAI-compatiblehttps://ark.cn-beijing.volces.com/api/v3
TokenHubOpenAI-compatiblehttps://tokenhub.tencentmaas.com/v1
MiniMaxOpenAI-compatiblehttps://api.minimaxi.com/v1
StepFunOpenAI-compatiblehttps://api.stepfun.com/v1
MiMoOpenAI-compatiblehttps://api.xiaomimimo.com/v1
SiliconFlowOpenAI-compatiblehttps://api.siliconflow.cn/v1
QianfanOpenAI-compatiblehttps://qianfan.baidubce.com/v2
BaichuanOpenAI-compatiblehttps://api.baichuan-ai.com/v1
YiOpenAI-compatiblehttps://api.lingyiwanwu.com/v1
ModelScopeOpenAI-compatiblehttps://api-inference.modelscope.cn/v1

International upstreams

UpstreamProtocolDefault base URL
OpenAIOpenAI-compatiblehttps://api.openai.com/v1
OpenRouterOpenAI-compatiblehttps://openrouter.ai/api/v1
AnthropicAnthropichttps://api.anthropic.com
GeminiGeminihttps://generativelanguage.googleapis.com
CohereCoherehttps://api.cohere.com/v2/chat
Mistral AIOpenAI-compatiblehttps://api.mistral.ai/v1
GroqOpenAI-compatiblehttps://api.groq.com/openai/v1
Together AIOpenAI-compatiblehttps://api.together.xyz/v1
Fireworks AIOpenAI-compatiblehttps://api.fireworks.ai/inference/v1
CerebrasOpenAI-compatiblehttps://api.cerebras.ai/v1
NVIDIA NIMOpenAI-compatiblehttps://integrate.api.nvidia.com/v1
PerplexityOpenAI-compatiblehttps://api.perplexity.ai
Novita AIOpenAI-compatiblehttps://api.novita.ai/openai/v1
DeepInfraOpenAI-compatiblehttps://api.deepinfra.com/v1/openai
SambaNovaOpenAI-compatiblehttps://api.sambanova.ai/v1
xAIOpenAI-compatiblehttps://api.x.ai/v1

Local and custom

UpstreamProtocolDefault base URL
OllamaOllamahttps://ollama.example.com
LM StudioOpenAI-compatiblehttps://lm-studio.example.com/v1
Custom OpenAI-compatibleOpenAI-compatibleUser supplied

In a container deployment, localhost points to the Lumoswitch container. Use a host address reachable from the container for Ollama or LM Studio. See Local models.

Verify actual capability

  1. Test the base URL and credential.
  2. Discover models visible to the account.
  3. Send a minimal chat request to the intended model.
  4. Test streaming, tools, vision, reasoning, or embeddings from the target client.

A preset does not grant access to every model or capability. Provider regions, projects, model IDs, and proprietary parameters can differ. OpenAI-compatible does not mean every OpenAI-specific parameter is supported.

On this page