Skip to content

Add opt-in idle model unloading to free VRAM - #889

Open
michael-borck wants to merge 2 commits into
jamiepine:mainfrom
michael-borck:feat/idle-model-unload
Open

Add opt-in idle model unloading to free VRAM#889
michael-borck wants to merge 2 commits into
jamiepine:mainfrom
michael-borck:feat/idle-model-unload

Check all backends before skipping an idle unload

13005f4
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs