github/ai-toolkit
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
1,485 Commits 9 Branches 0 Tags
main
Commit Graph

4 Commits

Author SHA1 Message Date
Jaret Burkett
85a6880643 Move the offload and quantization to the base model 2026-08-28 08:37:56 -06:00
Jaret Burkett
702254688d Added legacy paths 2026-08-28 07:55:19 -06:00
M. Hofer
f213e3b1e5 Fix FLUX2 Klein load-time VRAM spikes on low-memory GPUs. (#726) 
Keep the transformer and Qwen text encoder off CUDA during initial load/quantization in low-VRAM mode so model startup avoids full-model OOM before offloading and quantization can take effect.

Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-04-01 09:36:55 -06:00
Jaret Burkett
a6da9e37ac Add support for FLUX.2 klein base models 2026-01-17 17:46:25 -07:00