Ad

SRExpert

Stop juggling 6 Kubernetes tools.

Monitoring, alerts, security, Helm deploys and AI ops in one platform.

Start a 30-day free trial

Qwen/Qwen2.5-7B-Instruct

1mo

Age

2.1K

Likes

10M

Downloads

Collected

New text-generation model. Tags: qwen2, text-generation, chat, conversational, en, arxiv:2309.00071, arxiv:2407.10671, base_model:Qwen/Qwen2.5-7B

What it costs to run this

7.6B params · 32,768 Context

PrecisionNeedsCheapest that fits
16-bit18GBRTX 2080 Ti$0.07/h
8-bit9.2GBRTX 3060 laptop$0.03/h
4-bit4.6GBRTX 3060 laptop$0.03/h

Weights plus attention cache, with 15% added for activations and allocator overhead. Everything here is arithmetic — we do not measure speed, so we do not rank chips by it. See all GPU prices

Read the full article at huggingface.co

overfeed.news indexes and links. We publish a short excerpt — the full article stays at Hugging Face New Models.

Log in to follow this source
Qwen/Qwen2.5-7B-Instruct — overfeed.news