overfeed.news

Block-sparse GPU kernels

OpenAI Newsen

8a

Idade

Publicado
Coletado

We’re releasing highly-optimized GPU kernels for an underexplored class of neural network architectures: networks with block-sparse weights. Depending on the chosen sparsity, these kernels can run orders of magnitude faster than cuBLAS or cuSPARSE. We’ve used them to attain state-of-the-art results in text sentiment analysis and generative modeling of text and images.

Leia o artigo completo em openai.com

O overfeed.news indexa e aponta. Publicamos um trecho curto — o artigo completo fica em OpenAI News.

Entre para seguir esta fonte
Block-sparse GPU kernels — overfeed.news