DasPauluteli
a92f18bf71
krea2: don't hardcode the NVIDIA-only cuDNN SDPA backend ( #933 )
...
* krea2: don't hardcode NVIDIA-only cuDNN SDPA backend
The krea2 attention() forced SDPBackend.CUDNN_ATTENTION, which is
NVIDIA-only. On non-NVIDIA backends (AMD ROCm, Intel XPU, Apple MPS)
every forward pass fails with 'RuntimeError: No available kernel.
Aborting execution.', so Krea 2 LoRA training cannot run at all there.
Pass a priority list [CUDNN, FLASH, EFFICIENT, MATH] instead. NVIDIA
still selects cuDNN; other backends fall back to flash/efficient/math.
Verified training end-to-end on an AMD Radeon 8060S (gfx1151, ROCm 7.2).
* Version bump
* Add set priority flag so CUDNN_ATTENTION is selected on cuda devices first.
---------
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com >
2026-07-15 12:44:34 -06:00
Jaret Burkett
b8f8a08ba4
Fix sampling bar with anima
2026-07-15 12:17:06 -06:00
rmatif
3e6bd874c4
feat: Add Anima support ( #860 )
...
* Add Anima training support
* Update Anima modular training
* Use sample guidance for Anima
* Fix Anima sampling
* Limit Anima LoRA targets
* Convert Anima LoRA exports
* Fix Anima local loading
* Update Anima default model
* Pin upstream Anima diffusers
* Adjust template defaults to be consistent with other models. Update README
---------
Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com >
2026-07-15 11:59:01 -06:00
fatalis
8bbd051667
Add sample_start_step setting to configure when sampling starts ( #949 )
...
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com >
2026-07-15 11:15:50 -06:00
Jaret Burkett
30162c0602
Improvements for captioner quantization to speed it up. Block compile on captioners.
2026-07-15 10:25:47 -06:00
Jaret Burkett
691ddf434e
Add Qwen3.6 VL captioner.
2026-07-15 07:02:33 -06:00
Jaret Burkett
abba6b5845
Show better errors on captioner
2026-07-14 07:19:03 -06:00
Jaret Burkett
28f2c0acbe
Move z_image over to the new modeling class
2026-07-13 17:12:30 -06:00
Jaret Burkett
7602e476eb
Exclude sensative layers from quantization in krea
2026-07-13 10:14:53 -06:00
Jaret Burkett
ad07b06de5
Use cached first frame for wan22_5 model
2026-07-10 10:21:34 -06:00
Jaret Burkett
886c2aec57
Allow for vae tiling onle without low vram on wan models with a model kwarg
2026-07-10 09:42:52 -06:00
Jaret Burkett
fe82487187
Add tiling on vae decode for qwen image models when low vram flag is on
2026-07-10 09:07:29 -06:00
Jaret Burkett
e7951ad29e
Exclude sensative layers from quantization on wan models
2026-07-10 08:56:05 -06:00
Jaret Burkett
883d60eb71
Do vae tiling when decoding wan models with low vram active.
2026-07-10 08:02:32 -06:00
Jaret Burkett
a4bbe167ce
Added reference token attention isolation (kv_cache) for Krea2 edit training. Same training cost with significant inference speed up. 2x inference speedup.
2026-07-09 12:00:55 -06:00
Jaret Burkett
6233efe1bb
Fix sampling issue on zimage turbo and krea2 turbo models
2026-07-08 12:34:39 -06:00
Jaret Burkett
7bceec3b07
Apply a loss mask for first frame conditioning for wan and ltx
2026-07-07 09:05:53 -06:00
Jaret Burkett
bd93a312bc
Load more types of comfy ui style quants for ltx2
2026-07-07 09:04:51 -06:00
Jaret Burkett
b1e1a834d4
Added support to train Krea2 as an edit model
2026-07-04 09:12:39 -06:00
Jaret Burkett
4e50535478
Allow models to provide an additional loss
2026-06-28 09:49:36 -06:00
Jaret Burkett
1e12b6b73f
Remove duplicate save when triggering save next step
2026-06-28 07:18:16 -06:00
Jaret Burkett
7ee1f98f6d
Allow loading and saving z_image in comfy safetensors format.
2026-06-28 07:15:49 -06:00
Jaret Burkett
f8667f0334
Save Krea2 even if quantized
2026-06-28 06:03:37 -06:00
Jaret Burkett
4a99ddabad
Fix breaking change with diffusers qwen image
2026-06-26 10:04:35 -06:00
Jaret Burkett
5f04ae7ad5
Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning.
2026-06-25 13:19:38 -06:00
Jaret Burkett
d14f6e567a
Allow individual models to scale the loss after it is calculated.
2026-06-25 10:13:58 -06:00
Jaret Burkett
7a089fd0d7
Add support for training directly on Krea2 Turbo with a training adapter
2026-06-23 20:32:02 -06:00
Jaret Burkett
a803611ec1
Enable tiling on vae when decoding with low_vram flag on krea2
2026-06-23 18:38:52 -06:00
Jaret Burkett
724e67d634
Set krea 2 to use new lokr format
2026-06-23 13:31:50 -06:00
Jaret Burkett
e20b42e84a
Add offloading support for krea2
2026-06-23 10:43:36 -06:00
Jaret Burkett (Ostris)
99be3d96a2
Add support for Krea2 ( #906 )
...
* Add support for krea2
* Update repo pointer to actual repo
2026-06-23 09:18:14 -06:00
Jaret Burkett
820d534d6e
Add features for models that may need a non masked loss such as inpainiting.
2026-06-22 10:59:17 -06:00
Jaret Burkett
99f8fd44e3
Add a fallback bbox adjustment when json parsing fails on ideogram4 captioner
2026-06-19 07:25:54 -06:00
Jaret Burkett
022d1c29e0
Remove color pallet for individual objects in the caption prompts
2026-06-19 06:56:18 -06:00
Jaret Burkett
60c1ac6a50
Add support for Boogu Image and Boogu Image Edit
2026-06-18 15:05:49 -06:00
Jaret Burkett
e886745051
Added additional information on addine new models and some additional gotchas
2026-06-18 15:04:50 -06:00
Jaret Burkett
515b0ea5cd
Remove transformer log supression from captioner
2026-06-18 10:00:30 -06:00
Jaret Burkett
ad49d4ef25
Update example to cover some common issues
2026-06-18 07:54:37 -06:00
Jaret Burkett
66f7c06742
Patch away the qwen3vl conv3d that only has slow bf16 kernels
2026-06-17 14:29:20 -06:00
Jaret Burkett
92814f9e6d
Apply ideogram dynamic shifting to sampling
2026-06-16 18:52:16 -06:00
Jaret Burkett
178eb5fbbe
Add unconditional lora support so Ideogram 4 inference will more closely resemble the full pipeline results. I pushed a finetuned unconditional lora to the hub as an adapter.
2026-06-16 13:27:43 -06:00
Jaret Burkett
f6c0104f25
Handle unconditional conditioning for ideogram 4 more in line with example code.
2026-06-16 10:23:08 -06:00
Jaret Burkett
86b19589a0
Update the Ideogram 4 prompt generation/parsing/ui to handle the updated format notes better.
2026-06-16 09:44:38 -06:00
Jaret Burkett
fcccc0fbd2
Add gradient checkpointing to ideogram4 vae
2026-06-15 10:00:40 -06:00
Jaret Burkett
c0d600b5d6
Allow using flash backend for ideogram
2026-06-13 15:17:20 -06:00
Jaret Burkett
c8cd78b1a4
Allow nested transformer block names for quantization, lora targeting, quantizing
2026-06-13 14:33:16 -06:00
Jaret Burkett
6c3b82696e
Add support for PRX Pixel T2I
2026-06-13 09:47:53 -06:00
Jaret Burkett
a01c83073a
Added an example model with docs so people and agents can add models easier.
2026-06-13 08:17:06 -06:00
Jaret Burkett
0f580f0663
Add compiling option for captioning. Added progress bar for captioning on active job widget. Track steps on caption. Added reverse proxy iframe that plugins can use to add ui functionality.
2026-06-12 10:26:52 -06:00
Jaret Burkett
88127557f5
Comment out logging supression that was keeping weight loadings from being shown with transformers library
2026-06-11 07:53:41 -06:00
