A 120B LLM Without At Least 60GB RAM Is Impossible To Run, But One Individual Defied All Odds By Combining A Phone, Three Macs And Two Windows PCs To Make it Work

Wccftech 2h ago

A 120B LLM Without At Least 60GB RAM Is Impossible To Run, But One Individual Defied All Odds By Combining A Phone, Three Macs And Two Windows PCs To Make it Work

A 120B LLM like gpt-oss-120b would require a minimum of 60GB to 80GB of a combination of VRAM and system memory to run at decent performance, meaning that it’s absolutely necessary to have pricey hardware in your possession to achieve this…