BlogProcurement playbook
GB300 vs B300: Which Blackwell Ultra System to Reserve
You've picked Blackwell Ultra. Now you have to pick the system around it: 8-GPU HGX B300 servers or a 72-GPU GB300 NVL72 rack. Here's how to make that call for a reserved order.
Picture a head of infrastructure at a growing model lab who just won the budget argument for Blackwell Ultra. Finance signed off, the research leads agree on the GPU, and the reservation form has one field left blank: system. One proposal shows rows of HGX B300 servers. Another shows a GB300 NVL72 rack. Both list the same 288 GB of memory per GPU. The meeting where everyone thought the hard decision was over turns into a second meeting.
This guide is for procurement and infrastructure leads who have settled on Blackwell Ultra and now need to choose a form factor for a reserved order. If you're still weighing generations, the sibling post on GB200 vs B300 for reserved capacity covers that question. Here the GPU stays constant, and we look at everything around it: interconnect, facility, operations, software and contract language.
Comparing B300 against other GPUs instead? See B300 vs B200 for reserved capacity, H200 vs B300 for reserved buyers and H100 vs B300 for reserved capacity. If you need GPUs before a reservation lands, read how to rent B300 GPUs.
1. The one-line difference
HGX B300 is an 8-GPU server with x86 host CPUs. You scale out by connecting many of those servers over a network fabric. GB300 NVL72 is a liquid-cooled rack-scale system that joins 72 Blackwell Ultra GPUs with Grace CPUs in a single NVLink domain, so any GPU in the rack can reach any other over NVLink without touching the scale-out network.
In Pacific's catalog both list 288 GB per GPU, so memory per GPU is a wash. What changes is the size of the fast communication domain, the host CPU architecture, the cooling method, and the unit you service and contract for.
- HGX B300: 8 GPUs per node, NVLink inside the node, a network fabric between nodes, x86 hosts that run your existing images.
- GB300 NVL72: 72 GPUs per system, one NVLink domain across the rack, Grace (Arm) CPUs, liquid cooling required.
2. Which workloads actually need a 72-GPU NVLink domain
The large NVLink domain earns its keep when a single model's tensor or expert parallelism has to cross more than 8 GPUs. Once those communication-heavy groups spill past one node, traffic that would have stayed on NVLink has to travel over the fabric, and that's where rack-scale systems pull ahead.
- Training very large dense models where tensor parallel groups need to span more than one 8-GPU node.
- Mixture-of-experts models with heavy all-to-all traffic across many experts.
- Serving very large models where a single replica spans more than 8 GPUs and per-token latency matters.
Plenty of serious work runs well on 8-GPU nodes connected by a good fabric:
- Most fine-tuning, including full fine-tunes of large open models.
- Inference where the model and its KV cache fit inside one node.
- Data-parallel and pipeline-parallel training, where cross-node traffic is less sensitive to latency.
- Mixed queues and many independent jobs from different teams sharing one cluster.
A practical test: ask your research leads for the parallelism layout of the largest job planned during the reservation term. If tensor and expert groups stay at 8 GPUs or fewer, an HGX node covers them and everything else rides the fabric. If they need more than 8 and profiling shows cross-node communication dominating step time, NVL72 starts to justify its extra facility and operational demands. Also think about utilization. A 72-GPU domain is a large block to keep busy, and if most of your jobs are small, you'll need a plan for packing them onto it.
3. Site and facility fit
This is often where the decision gets made for you. Rack-scale systems need liquid cooling and much denser racks than most existing data halls were designed for. Plan power, cooling and floor loading with the site before you commit, and get answers in writing.
- Cooling: is there a facility water loop or coolant distribution capacity for direct-to-chip liquid cooling, and who owns it?
- Power delivery: can the rack position receive the power the system needs, with the redundancy you expect?
- Floor loading: is the floor rated for a fully integrated, liquid-filled rack?
- Access route: can a heavy integrated rack physically travel from the dock to its position?
- Service clearances: is there room to pull trays and work on the rack safely?
HGX B300 is easier to place because the unit is a single server, but it's still a dense, high-power system, and depending on configuration it may be air or liquid cooled. Confirm requirements per site either way. Keep verified facts separate from assumptions that still need utility, landlord or engineering confirmation. A power letter, an access route and a drawing answer different questions, and you need all three.
4. Failure domains and day-two operations
With HGX, a failed node takes out 8 GPUs and your scheduler routes around it. A GB300 NVL72 rack is one larger unit to service. A fault in a shared component, such as a switch tray, power shelf or cooling element, can affect jobs across the whole system, and a job sized to the full 72-GPU domain stops until the rack is healthy.
Neither is wrong, but the operating plan is different. Before you reserve, settle these:
- Which components are field-replaceable on site, and which go back through RMA?
- What spares are held on site or nearby, and who performs the swap?
- Can the rack run in a degraded state, and how will your scheduler handle a partial domain?
- How are maintenance windows scheduled when servicing one part affects 72 GPUs?
- What does replacement of a whole system look like if a rack can't be repaired in place?
5. Host CPU and software stack
Grace is an Arm CPU. That matters more than many teams expect. Your x86 container images won't run on it as-is, and every layer of the host stack needs an aarch64 build.
- Container images: are your base images and internal builds multi-arch?
- Drivers and CUDA: confirm supported versions for Grace-based systems match what your frameworks need.
- Python wheels and custom kernels: check for prebuilt Arm wheels, or budget time to compile.
- Tooling: monitoring agents, security and endpoint software, schedulers and storage clients.
- CI: can your pipelines build and test Arm images before the hardware arrives?
HGX B300 nodes use x86 hosts, so existing images, agents and runbooks generally carry over with a driver and CUDA update. If you choose GB300 NVL72, run a porting pilot on Arm hardware early and treat software readiness as a gating item next to facility readiness.
6. Allocation, configuration freeze and delivery
Treat each of these as a schedule risk, and get them confirmed per project rather than assumed from a slide.
- Allocation: rack-scale systems are allocated as whole units, so ask what's confirmed against your order and when.
- Configuration freeze: agree the configuration early. Changes after freeze can reset sourcing and integration.
- Delivery and commissioning: liquid-cooled systems add site commissioning steps, and integration testing takes time on any cluster.
On Pacific's side, the reserved B300 capacity offer is built on the HGX B300 Pod 32 reference: a single-tenant bare-metal cluster of 32 HGX B300 nodes with a dedicated, configurable fabric. The configuration and delivery window are confirmed through a project review and written offer, and the deployment timeline is a target confirmed site by site, never a guaranteed date. GB300 NVL72 appears as by request in Pacific's GPU compute catalog of dedicated bare-metal nodes. If your workload analysis points to NVL72, raise it on the project review so it can be assessed against your site and timeline.
7. What to write into the reservation
Whichever system you choose, the reservation should leave no room for interpretation about what's being delivered.
- Named system: the exact form factor, HGX B300 nodes or GB300 NVL72 systems, with quantities.
- Configuration baseline: GPU, host CPU, memory, local storage, network adapters, fabric topology and cooling method.
- Acceptance criteria: the tests, thresholds and evidence that define a ready cluster. See acceptance criteria for reserved B300 clusters for a working checklist.
- Substitution terms: no change of system, component or configuration without your written consent.
- Delivery language: a confirmed window, what happens if it moves, and how you're notified.
- Service terms: spares, RMA handling and response expectations for the unit you're actually buying.
8. A simple scorecard to decide
Score each line for your situation. If most answers land in the HGX column, reserve HGX B300. If the workload and facility lines both point to NVL72, take that case to your provider's project review.
- Workload: do tensor or expert parallel groups need more than 8 GPUs? Yes favors NVL72. No favors HGX.
- Job mix: one or a few very large jobs favor NVL72. Many smaller or independent jobs favor HGX.
- Facility: is liquid cooling, dense rack power and floor loading confirmed in writing? If not, HGX is the safer reserve.
- Software: are your images, wheels and tooling Arm-ready? If not, add porting time or lean HGX.
- Operations: can your team plan around a 72-GPU failure domain and rack-level servicing?
- Schedule: does your timeline tolerate added commissioning and integration steps?
- Contract: can you name the system, baseline and acceptance criteria cleanly for either option?
When you're ready to test your scorecard against a real site and configuration, Pacific Intelligent Technologies, Inc. can walk through the HGX B300 Pod 32 reference and review a GB300 NVL72 request alongside it. Book a 30-minute project review call and bring your largest planned job layout and your site details.
FAQ
Is the GPU in GB300 the same as in B300?
Both use Blackwell Ultra GPUs, and Pacific's catalog lists 288 GB per GPU for B300 SXM and GB300 NVL72. The difference is the system: 8 GPUs per HGX node with x86 hosts and a scale-out fabric, versus 72 GPUs in one NVLink domain with Grace CPUs and liquid cooling.
Can I reserve HGX B300 now and move to GB300 NVL72 later?
A later move depends on a separate GB300 NVL72 request and project review. HGX lets existing x86 software and runbooks carry over while you prepare Arm builds and confirm facility readiness for rack-scale systems. Keep your containers multi-arch from the start so a later move is a deployment project instead of a rewrite.
Does Pacific offer reserved GB300 NVL72 capacity?
Pacific's reserved B300 offer is based on the HGX B300 Pod 32 reference. GB300 NVL72 is listed by request in the compute catalog, with pricing by request. If your workload needs a 72-GPU NVLink domain, raise it during the project review so feasibility, site fit and timing can be assessed for your specific project.
Continue on the mothership
This satellite stops at the playbook. Transactions, specs, and comparisons live on pacificmachines.com. If the next step is a human, book 30 minutes with Harper.