Nvidia Nemotron 3 Ultra Beats US Open Weight Rivals
Model Release

Nvidia Nemotron 3 Ultra Beats US Open Weight Rivals

Nvidia's Nemotron 3 Ultra is a 550B open model that tops US open-weights rankings at 300 tokens per second, with weights and training recipes released.

Share:XLinkedIn

Key Takeaways

  • Nemotron 3 Ultra is a 550B-parameter open model with 55B active parameters and an Intelligence Index of 48, topping US open-weight rankings.
  • Nvidia claims 300-plus tokens per second, 5x faster than Qwen3.5-122B and 2.2x faster than GPT-OSS-120B.
  • The model runs at roughly 30% lower inference cost than comparable models, tuned for Nvidia hardware.
  • Benchmark scores include 92.1% HumanEval, 89.4% MMLU, and 94.2% on RULER at 256K context.
  • Nvidia released training recipes and a large portion of training data, not just weights, fueling more GPU demand.

Nvidia just shipped a 550-billion-parameter language model and released the training recipe alongside it. The number that matters is not the parameter count. It is 48, the Intelligence Index score that pushed Nemotron 3 Ultra past every other open-weight model trained in the United States.

What Actually Happened

On June 1, 2026, Nvidia CEO Jensen Huang opened the Computex keynote at the Taipei Music Center and unveiled Nemotron 3 Ultra, a 550-billion-parameter open model that activates only 55 billion parameters per token. The model posts an Intelligence Index of 48, which Nvidia says tops the rankings for open-weight models built in the US. It runs at 300-plus tokens per second and handles a context window of up to 1 million tokens. The architecture is a hybrid Mamba-Transformer mixture-of-experts design that Nvidia calls LatentMoE, paired with multi-token prediction to push throughput.

The benchmark sheet is aggressive. Nemotron 3 Ultra scores 92.1% on HumanEval for coding, 89.4% on MMLU, and 94.2% on RULER at 256K context. On agentic workflows, Nvidia reports 91% task completion across multi-step tool use. The company claims the model runs 5x faster than Alibaba's Qwen3.5-122B and 2.2x faster than OpenAI's GPT-OSS-120B, at roughly 30% lower inference cost than comparable models. Crucially, Nvidia published not just the weights but the training recipes and a large portion of the training data, the detail that separates a genuinely open model from one that is merely downloadable. General availability is slated for the Q2 to Q3 2026 window.

Nemotron 3 Ultra did not arrive alone. The same keynote rolled out Cosmos 3, the first open Physical AI omnimodel for robotics, the RTX Spark Windows PC chip with Grace and Blackwell silicon and 128GB of unified memory starting near $1,499 in fall 2026, the DGX Station desktop priced between $45,000 and $85,000 for spring 2026, and a preview of Vera CPUs. Huang framed the whole stack around a single claim: Nvidia is no longer a chip company, it is a full-stack AI platform company that intends to own every layer from the power grid to the application.

Stay Ahead

Get daily AI signals before the market moves.

Join founders, investors, and operators reading TechFastForward.

Why This Matters More Than People Think

For two years the open-weight frontier has been a Chinese story. Qwen, DeepSeek, Kimi, and MiniMax set the pace while US labs guarded their best models behind paid APIs. Nemotron 3 Ultra is the first credible American answer at the very top of the open leaderboard, and it comes from the company that already sells the hardware everyone uses to train and serve these models. That vertical position changes the calculus for every team deciding whether to build on an open base instead of renting a closed one.

The economics are the real headline. A model that runs 5x faster than a leading Chinese open model at 30% lower inference cost is not just a benchmark trophy. It is a margin lever for any company running inference at scale. When the same vendor controls the GPU, the networking fabric, the inference software, and now a leading open model tuned to that stack, the cost curve bends in Nvidia's favor and away from rivals who only sell one layer of the sandwich.

There is a second, quieter audience: governments and regulated industries. Sovereign AI programs in Europe, the Gulf, Korea, and Japan have wanted a frontier-class open model they can host on their own soil without depending on a Chinese lab or accepting a US frontier lab's usage terms. A US-origin open model with published weights and recipes is exactly the artifact those buyers have been waiting for, and Nvidia happens to sell the data-center hardware they will run it on.

The Competitive Landscape

The direct targets are explicit. Alibaba's Qwen3.5-122B and OpenAI's GPT-OSS-120B are named in Nvidia's own speed comparisons, and DeepSeek and Meta's Llama line sit in the same competitive set. Meta in particular has lost the grip on the open-weight crown it held with early Llama releases, and Nemotron 3 Ultra now hands enterprises a US-built alternative that does not require trusting a foreign supply chain or a frontier lab's API terms.

But the sharper competition is not against other model makers. It is against Nvidia's own customers in silicon. AMD with its MI series, Groq, Cerebras, and the hyperscaler chip teams at Google, Amazon, and Microsoft have all pitched themselves as cheaper homes for inference. By releasing a top open model optimized for its own chips, Nvidia raises the switching cost: the best free model now runs best on Nvidia hardware. That is a defensive moat dressed up as a gift to the open-source community.

The frontier labs feel it too. OpenAI, Anthropic, and Google sell intelligence as a metered service. A free model that lands within striking distance of their mid-tier offerings compresses the price umbrella under which they operate. Each of them is also a giant Nvidia customer, which is why this release carries a whiff of awkwardness. The supplier just shipped a product that competes with its biggest buyers, and it did so while those buyers remain dependent on its chips to train their own answers.

Hidden Insight: The Recipe Is the Weapon, Not the Weights

Most coverage will fixate on the 550B parameter count and the leaderboard rank. The more durable move is that Nvidia released the training recipes and a large slice of the data. Weights let you run a model. Recipes let you build the next one. By open-sourcing the method, Nvidia is teaching the entire ecosystem to train Nemotron-style models, and every one of those training runs consumes Nvidia GPUs. The model is a loss leader for the compute business underneath it.

This is the same playbook that made CUDA unkillable. Nvidia did not win developer mindshare by keeping CUDA secret. It won by making CUDA the path of least resistance and ensuring that path ran on its silicon. Nemotron 3 Ultra extends that logic up the stack from the kernel to the model. The bet is that owning the reference implementation of a leading open model is worth far more than the licensing revenue Nvidia gives up by handing it out for free. Mindshare today becomes hardware orders tomorrow.

The bear case, however, is straightforward and worth taking seriously. Open-weight leaderboards are noisy, and an Intelligence Index of 48 is a composite that can hide weak spots on the tasks enterprises actually run. Skeptics point out that Nvidia is grading its own homework: the speed and cost comparisons come from Nvidia, measured on Nvidia hardware, against competitors Nvidia selected. Independent evaluations from groups like Artificial Analysis will take weeks to land, and history says vendor benchmarks tend to compress once third parties reproduce them. There is also the structural tension of a chip company shipping a frontier model that competes with the labs paying its bills, a friction that could cool relationships with OpenAI, Anthropic, and the hyperscalers over time.

Still, the underlying logic holds even if the benchmarks soften under scrutiny. Nvidia does not need Nemotron 3 Ultra to be the single best model in the world. It needs it to be good enough that teams reach for it first, and tuned well enough that reaching for it means buying more Nvidia compute. On that narrower and more honest measure, the release already works regardless of where the leaderboard settles.

What to Watch Next

In the next 30 days, watch for independent benchmark reruns from Artificial Analysis, LMArena, and the broader open evaluation community. If the Intelligence Index of 48 holds up outside Nvidia's own test harness, the leaderboard story is real and the open-weight center of gravity shifts toward the US for the first time in two years. Watch too for how Qwen and DeepSeek respond, because both ship on a fast cadence and will not cede the open crown quietly. A counter-release within the quarter is the base case, not a surprise.

Over the 90 to 180-day horizon, the signal to track is adoption inside enterprises and inference providers. If Fireworks, Together, Baseten, and the major clouds add Nemotron 3 Ultra to their menus and it climbs in real usage rather than just download counts, the loss-leader strategy is paying off. The deeper tell is whether developers start training derivatives from Nvidia's published recipe. The week a wave of fine-tuned Nemotron variants floods Hugging Face is the week Nvidia's open-model gambit graduates from a launch event into an industry standard, and the compute meter starts spinning on every one of those runs.

Nvidia did not give away a model. It gave away the recipe, and every batch baked from it cooks on Nvidia silicon.


Key Takeaways

  • 550B parameters, 55B active, Nemotron 3 Ultra tops US open-weight rankings with an Intelligence Index of 48.
  • 300+ tokens per second, Nvidia claims 5x the speed of Qwen3.5-122B and 2.2x GPT-OSS-120B.
  • 30% lower inference cost, the model is tuned to run cheapest on Nvidia's own hardware.
  • 92.1% HumanEval, 89.4% MMLU, 94.2% RULER at 256K, strong coding, reasoning, and long-context scores.
  • Recipes and data released, Nvidia open-sourced the training method, not just the weights, fueling more GPU demand.

Questions Worth Asking

  1. If the best free model runs best on one vendor's chips, is open source widening developer choice or quietly narrowing it?
  2. When a hardware company ships a frontier model, does it strengthen or strain its relationships with the labs that are its biggest buyers?
  3. How would your infrastructure budget change if a top open model cut inference spend by 30%, and what would you build that you cannot afford today?
Newsletter

Enjoyed this analysis? Get the next one in your inbox.

Daily AI signals. No noise. Built for founders, investors, and operators.

Share:XLinkedIn
</> Embed this article

Copy the iframe code below to embed on your site:

<iframe src="https://techfastforward.com/embed/nvidia-nemotron-3-ultra-beats-us-open-weight-rivals" width="480" height="260" frameborder="0" style="border-radius:16px;max-width:100%;" loading="lazy"></iframe>