MSI intros new workstation PC with an incredible 496 GB of RAM and 72-core CPU

Folks with really, really deep pockets and a knack for local LLMs will be pleased to note that MSI has introduced a new AI workstation PC, the WS300, powered by Nvidia's GB300 Grace Blackwell Ultra chip.

The GB300 chip features an Nvidia Grace CPU with a whopping 72 ARM-based Neoverse V2 cores and an Nvidia Blackwell Ultra GPU. Combined, the system features a whopping 748 GB of coherent memory.

Moreover, the Grace CPU is paired with a whopping 496 GB of LPDDR5X RAM, while the Blackwell Ultra GPU sports a whopping 252 GB of HBM3e VRAM with an incredible 7.1 TB/sec bandwidth. 

Those who are not satisfied with the GPU capabilities for whatever reason can also attach an additional NVIDIA RTX Pro Blackwell GPU via the PC's PCIe expansion slot.

For those curious, Nvidia claims that the platform is capable of up to 20 petaflops of AI compute (FP4) performance, which should be enough to support models with up to 1 trillion parameters without required to be split across multiple systems. 

The MSI WS300 DGX Station workstation PC also features support for the Nvidia ConnectX-8 SuperNIC, allowing for up to 800 Gbps of networking speeds. For those with not one but two DGX stations, the aforementioned NIC will come in handy for combining compute horsepower. Finally, storage is handled by dual M.2 slots.

It is unclear just how expensive the MSI WS300 will be, but given the specs on offer, it is more than certain to cost a small fortune. In light of recent events, a price tag close to $100,000 won't be surprising.

For the rest of us mere mortals with slightly smaller pockets, AMD Strix Halo-powered mini PCs can be a good starting point for local LLMs, such as the GMKtec Evo X2, currently available for $2,199 on Amazon.