Ad

Privum

We build, secure and run your digital infrastructure.

Software, AI systems, penetration testing and secure cloud for companies.

Talk to Privum

AikidoSec/altar-1

1mo

Age

126

Likes

739

Downloads

Collected

New text-generation model. Tags: glm_moe_dsa, glm, glm-5.3, moe, w4a16, awq, int4, compressed-tensors

What it costs to run this

500.8B params · 32,768 Context

PrecisionNeedsCheapest that fits
16-bit1118GBMI300X × 6$14.34/h
8-bit559GBGB10 × 5$1.20/h
4-bit279GBMI350X$5.49/h

Weights plus attention cache, with 15% added for activations and allocator overhead. Everything here is arithmetic — we do not measure speed, so we do not rank chips by it. See all GPU prices

Read the full article at huggingface.co

overfeed.news indexes and links. We publish a short excerpt — the full article stays at Hugging Face New Models.

Log in to follow this source
AikidoSec/altar-1 — overfeed.news