Buscar
Busca
490
AMD MI300X vs NVIDIA H100 SXM: Mixtral 8x7B Inference
Runpod benchmarks AMD's MI300X against Nvidia's H100 SXM using Mistral's Mixtral 8x7B model. The results highlight performance and cost trade-offs across.
en
Detecting and recovering from silent data corruption on Amazon SageMaker HyperPod
Silent data corruption is a GPU fault that returns wrong but plausible numbers with no error, quietly poisoning distributed training. This post adds three checks to a PyTorch DDP loop to detect it, localize the faulty node on Amazon SageMaker HyperPod, and hand the node to automatic recovery for replacement.
en
Nvidia’s stock drops as board reportedly preps to oust CEO Jensen Huang
As soon as Wednesday evening, Nvidia's board could decide to remove its founder and CEO of 33 years.
en
Jensen Huang accused of having another affair — with a Nvidia exec
Jensen Huang, who has come under fire for admitting to an affair with a woman accused of being a Chinese intelligence agent, has been accused…
en
The US is winning the AI race. Jensen Huang could have blown it
As espionage targets go, Jensen Huang is perhaps one of the least surprising on Earth. The Nvidia CEO runs one of the world's most valuable…
en
NVIDIA A40 and A6000 for Budget LLM Fine-Tuning
Discover why NVIDIA's A40 and A6000 GPUs are the best-kept secret for budget-conscious LLM fine-tuning. With 48GB VRAM, strong availability, and low cost.
en
A short seller flagged Nvidia CEO’s ties to a suspected Chinese spy six months before the scandal
Six months before Nvidia's spy scandal erupted, Culper Research was already questioning Jensen Huang's unusually close relationship with a Chinese executive.
en
The race is on to sue Nvidia
Nvidia’s stock slid more than 4% after its board opened an investigation into Jensen Huang’s relationship with a suspected Chinese spy, and one securities law…
en
Jensen Huang pulls out of ElevenLabs Summit amid Nvidia controversy
The Nvidia CEO also pulled out of an Anthropic event earlier.
en
Jensen Huang’s affair with alleged Chinese spy puts Nvidia’s China ambitions under scrutiny
Jensen Huang’s alleged affair with a suspected Chinese spy threatens to complicate Nvidia’s lobbying efforts to loosen U.S. chip export restrictions and maintain access to…
en
Inference Validation for Regulated AI: Building a Decision Pipeline on NVIDIA AIPerf
Deploying large language models in regulated industries requires more than picking the fastest inference engine: it requires evidence that a configuration meets contractual and legal obligations before it serves a single customer request. We describe Runway, an internal validation harness built at MasterControl that builds a governed decision pipeline around NVIDIA AIPerf. The key insight is separating concerns: AIPerf provides the trusted measurement, while Runway provides the experiment design that comes before it and the compliance, cost, and audit decisions that come after. We describe the architecture and the storage model that makes caching and audit one mechanism. We report three findings from Runway sweeps: TensorRT-LLM and vLLM rankings invert with concurrency; a newer, pricier GPU instance can be the cheaper one per request; and speculative decoding behaves differently across engines under load, so engine configuration can outweigh engine choice.
en
Megaspeed exec was recruited to spy on Nvidia CEO, according to US intelligence memo
A memo circulated earlier this year reportedly claimed that China’s Ministry of State Security recruited a female technology executive to spy on Nvidia's CEO.
en
The US let Nvidia sell chips to an empty office in China
Concerns are being raised that neither the Commerce Department nor Nvidia are doing their due diligence when it comes to vetting Chinese firms cleared to…
en
China reportedly recruited AI exec to spy on Jensen Huang
China's intelligence agency recruited Megaspeed executive Alice Huang to spy on Nvidia CEO Jensen Huang, according to The New York Times. The Ministry of State…
en
