OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show
1mês
- Publicado
- Coletado
Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.
O overfeed.news indexa e aponta. Publicamos um trecho curto — o artigo completo fica em TechCrunch AI.
Mais de TechCrunch AI
Entre para seguir esta fonte
Science Corporation implants its vision-restoring chip in its first Stargardt disease patient
Max Hodak, the former president and co-founder of Neuralink, detailed on stage at TechCrunch Disrupt how his company's work with PRIMA is part of its…
Cerebras CEO says we’re nearing a future where everyone has a personal AI assistant at home
Cerebras CEO Andrew Feldman predicts a future where personal AI assistants become as commonplace as household appliances, running partly on local devices and partly in…
Industrial Next wants factory robots to switch tasks in minutes, not weeks
Industrial Next helps manufacturers automate complex, delicate tasks that have traditionally required human labor.
Cerebras CEO pushes back on AI doomsday warnings
Cerebras CEO Andrew Feldman has a message for AI leaders spreading doomsday warnings: Maybe stop talking? At TechCrunch Disrupt, he argued that the industry's focus…