More intelligence
per machine.
Efficient inference for capable open models—starting with Qwen3.6-27B and its canonical Hugging Face model identity.
- Public route
- Canonical
- Runtime
- AWQ + MTP1
- Modalities
- Text + vision
One model identity.
A more efficient runtime.
Clients request the canonical Qwen/Qwen3.6-27B model ID. Quantization and runtime optimization stay behind the provider boundary instead of leaking a derived route into client code.
Canonical on the outside
Provider-side optimization without a new public model name.
Long context with headroom
84.64% of the native context window, reserving capacity for concurrent traffic, tools, images, and speculative decoding.
Engineered for 48 GB GPUs
A larger multimodal model, qualified on a single RTX A6000 instead of requiring a multi-card serving node.
Measured under mixed traffic.
The selected profile was tested with streaming, non-streaming, structured output, tool calls, and image requests—not a single idealized prompt loop.
More aggregate throughput. Full measured validity.
The MTP1 profile improved aggregate output throughput while every request in the measured suite remained valid.
Compare provider listingsMeasured on one RTX A6000 with a fixed-seed, mixed 100-request workload at concurrency eight; one warm-up and three measured repetitions.
Built for the Hugging Face ecosystem.
A familiar inference surface that preserves the canonical model identity across clients, routing, and billing.