It seems like register_offload_parameter is trying to offload the parameter to CPU or some non-gpu device, but maybe isn’t actually working. Maybe the offloading framework isn’t set up properly, a condition isn’t met, or the dict it’s offloading to is actually still in GPU memory. Either way, let's try the simple thing of not making the parameter and explicitly deleting weight_data.
For the fourth month in a row, Framework is increasing prices on RAM and storage for its modular PCs due to ongoing shortages from suppliers. An update to Framework's blog on Tuesday states that DDR5 RAM will now cost $13 to $18 per GB, up from February's rate of $12 to $16 per GB. This is partly due to the company selling out of older, less expensive inventory, which has also pushed Framework to "re-price some capacities" of storage, as well.
，这一点在WhatsApp Web 網頁版登入中也有详细论述
Полковник высказался о новом уровне конфликта Ирана с США и Израилем14:52
Подсчитаны траты рядового американца на войну с Ираном08:45