Qwen Console

multi-model gateway

checking
Live decode—tok/s · streaming
TTFT—time to first token
Output—tokens this reply
Backend load—running / queued
✦

Ask anything

Pick a model and choose the exact Qwen thinking effort.

0 / 32k ctx
⚙
Throughput—tok/s · all models
Active—running requests
Pending—queued requests
Total calls—since start
Prefix cache—hit rate
Mean call—inference time

GPUs utilization & VRAM

Throughput tok/s · last 2 min

History from the audit log — survives reloads and restarts

MTP acceptance draft accept · last 2 min

Backends

ModelGPURunWaittok/sKVCacheMTP

Model endpoints what's serving right now

ModelStatusEngineGPUEndpoint (OpenAI /v1)CtxCapabilities

Access points how to reach these models

Call History —

1
TimeModelSrcClientStatusRecvPromptOutTTFTtok/s

Call