Ad

Privum

We build, secure and run your digital infrastructure.

Software, AI systems, penetration testing and secure cloud for companies.

Talk to Privum

taobao-mnn/MNN-Pocket-0.3B

2d

Age

93

Likes

2.4K

Downloads

Collected

New text-generation model. Tags: qwen3, text-generation, mnn, mnn-pocket, on-device, edge, int4, conversational

What it costs to run this

0.36B params · 32,768 Context

PrecisionNeedsCheapest that fits
16-bit1.3GBRTX 3060 laptop$0.03/h
8-bit0.6GBRTX 3060 laptop$0.03/h
4-bit0.3GBRTX 3060 laptop$0.03/h

Weights plus attention cache, with 15% added for activations and allocator overhead. Everything here is arithmetic — we do not measure speed, so we do not rank chips by it. See all GPU prices

Read the full article at huggingface.co

overfeed.news indexes and links. We publish a short excerpt — the full article stays at Hugging Face New Models.

Log in to follow this source
taobao-mnn/MNN-Pocket-0.3B — overfeed.news