Ad

Privum

We build, secure and run your digital infrastructure.

Software, AI systems, penetration testing and secure cloud for companies.

Talk to Privum

RecursiveSI/flint

22d

Age

125

Likes

Collected

New text-generation model. Tags: flint, text-generation, conversational, license:apache-2.0

What it costs to run this

39.8B params · 32,768 Context

PrecisionNeedsCheapest that fits
16-bit89GBGB10$0.24/h
8-bit44GBGB10$0.24/h
4-bit22GBRTX 3090$0.10/h

Weights plus attention cache, with 15% added for activations and allocator overhead. Everything here is arithmetic — we do not measure speed, so we do not rank chips by it. See all GPU prices

Read the full article at huggingface.co

overfeed.news indexes and links. We publish a short excerpt — the full article stays at Hugging Face New Models.

Log in to follow this source
RecursiveSI/flint — overfeed.news