-
chevron_right
Open-Source "GreenBoost" Driver Aims To Augment NVIDIA GPUs vRAM With System RAM & NVMe To Handle Larger LLMs
news.movim.eu / Phoronix • 0:17
An open-source, independently developed Linux kernel module called GreenBoost aims to augment the dedicated video memory on NVIDIA discrete GPUs with system memory and NVMe storage. The intent here with GreenBoost is a CUDA caching layer to more easily run larger AI models for LLMs that otherwise won't fit solely in your graphics card's dedicated vRAM...