OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show
2mo
- Published
- Collected
Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.
overfeed.news indexes and links. We publish a short excerpt — the full article stays at TechCrunch AI.
More from TechCrunch AI
Log in to follow this source
Democrats launch Nvidia investigation, write scathing letter on Huang’s ‘scheme’ with Trump
This Congressional investigation into Nvidia's China sales and its dealings with Trump is the second one, so far, since news of the alleged spy affair…
Muse can now place calls to U.S. businesses — if you pay
Muse's AI can now place outbound calls to US businesses — but it's not free.
Nebius tests the neocloud playbook with $40 billion in planned spending
Nebius plans to fund its $40 billion AI infrastructure expansion through customer prepayments and loans, even as delays at a Microsoft data center raise questions…
Jensen Huang was having a third affair, Reuters reports
Reuters is withholding the name of the new employee linked to Huang, but says she is an employee of Nvidia.