OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show
1mo
- Published
- Collected
Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.
overfeed.news indexes and links. We publish a short excerpt — the full article stays at TechCrunch AI.
More from TechCrunch AI
Log in to follow this source
Science Corporation implants its vision-restoring chip in its first Stargardt disease patient
Max Hodak, the former president and co-founder of Neuralink, detailed on stage at TechCrunch Disrupt how his company's work with PRIMA is part of its…
Cerebras CEO says we’re nearing a future where everyone has a personal AI assistant at home
Cerebras CEO Andrew Feldman predicts a future where personal AI assistants become as commonplace as household appliances, running partly on local devices and partly in…
Industrial Next wants factory robots to switch tasks in minutes, not weeks
Industrial Next helps manufacturers automate complex, delicate tasks that have traditionally required human labor.
Cerebras CEO pushes back on AI doomsday warnings
Cerebras CEO Andrew Feldman has a message for AI leaders spreading doomsday warnings: Maybe stop talking? At TechCrunch Disrupt, he argued that the industry's focus…