Ad

NexTalk

Automate the first reply. Keep the human touch.

Live chat with AI agents on your own model and API key, with handoff to your team.

Start free

orcarouter/OrcaSAQ-2-27B

1mo

Age

112

Likes

359

Downloads

Collected

New text-generation model. Tags: vllm, qwen3_5, qwen, qwen3.8, orcasaq2, quantization, mixed-precision, 3-bit

What it costs to run this

6.8B params · 32,768 Context

PrecisionNeedsCheapest that fits
16-bit24GBRTX 3090$0.10/h
8-bit12GBRTX 3060 laptop$0.03/h
4-bit5.9GBRTX 3060 laptop$0.03/h

Weights plus attention cache, with 15% added for activations and allocator overhead. Everything here is arithmetic — we do not measure speed, so we do not rank chips by it. See all GPU prices

Read the full article at huggingface.co

overfeed.news indexes and links. We publish a short excerpt — the full article stays at Hugging Face New Models.

Log in to follow this source
orcarouter/OrcaSAQ-2-27B — overfeed.news