Jaret Burkett
92bdb6e473
Add support for Mage-Flow and Mage-Flow Edit
2026-07-25 11:34:20 -06:00
Jaret Burkett
f1bc6508ad
Fix issue with qwen image edit models.
2026-07-17 09:14:04 -06:00
Jaret Burkett
5cb54ba9cc
Allow setting weight saving flag on hidream_o1
2026-07-16 07:40:25 -06:00
DasPauluteli
a92f18bf71
krea2: don't hardcode the NVIDIA-only cuDNN SDPA backend ( #933 )
...
* krea2: don't hardcode NVIDIA-only cuDNN SDPA backend
The krea2 attention() forced SDPBackend.CUDNN_ATTENTION, which is
NVIDIA-only. On non-NVIDIA backends (AMD ROCm, Intel XPU, Apple MPS)
every forward pass fails with 'RuntimeError: No available kernel.
Aborting execution.', so Krea 2 LoRA training cannot run at all there.
Pass a priority list [CUDNN, FLASH, EFFICIENT, MATH] instead. NVIDIA
still selects cuDNN; other backends fall back to flash/efficient/math.
Verified training end-to-end on an AMD Radeon 8060S (gfx1151, ROCm 7.2).
* Version bump
* Add set priority flag so CUDNN_ATTENTION is selected on cuda devices first.
---------
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com >
2026-07-15 12:44:34 -06:00
Jaret Burkett
b8f8a08ba4
Fix sampling bar with anima
2026-07-15 12:17:06 -06:00
rmatif
3e6bd874c4
feat: Add Anima support ( #860 )
...
* Add Anima training support
* Update Anima modular training
* Use sample guidance for Anima
* Fix Anima sampling
* Limit Anima LoRA targets
* Convert Anima LoRA exports
* Fix Anima local loading
* Update Anima default model
* Pin upstream Anima diffusers
* Adjust template defaults to be consistent with other models. Update README
---------
Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com >
2026-07-15 11:59:01 -06:00
Jaret Burkett
28f2c0acbe
Move z_image over to the new modeling class
2026-07-13 17:12:30 -06:00
Jaret Burkett
7602e476eb
Exclude sensative layers from quantization in krea
2026-07-13 10:14:53 -06:00
Jaret Burkett
ad07b06de5
Use cached first frame for wan22_5 model
2026-07-10 10:21:34 -06:00
Jaret Burkett
886c2aec57
Allow for vae tiling onle without low vram on wan models with a model kwarg
2026-07-10 09:42:52 -06:00
Jaret Burkett
fe82487187
Add tiling on vae decode for qwen image models when low vram flag is on
2026-07-10 09:07:29 -06:00
Jaret Burkett
e7951ad29e
Exclude sensative layers from quantization on wan models
2026-07-10 08:56:05 -06:00
Jaret Burkett
883d60eb71
Do vae tiling when decoding wan models with low vram active.
2026-07-10 08:02:32 -06:00
Jaret Burkett
a4bbe167ce
Added reference token attention isolation (kv_cache) for Krea2 edit training. Same training cost with significant inference speed up. 2x inference speedup.
2026-07-09 12:00:55 -06:00
Jaret Burkett
6233efe1bb
Fix sampling issue on zimage turbo and krea2 turbo models
2026-07-08 12:34:39 -06:00
Jaret Burkett
7bceec3b07
Apply a loss mask for first frame conditioning for wan and ltx
2026-07-07 09:05:53 -06:00
Jaret Burkett
bd93a312bc
Load more types of comfy ui style quants for ltx2
2026-07-07 09:04:51 -06:00
Jaret Burkett
b1e1a834d4
Added support to train Krea2 as an edit model
2026-07-04 09:12:39 -06:00
Jaret Burkett
7ee1f98f6d
Allow loading and saving z_image in comfy safetensors format.
2026-06-28 07:15:49 -06:00
Jaret Burkett
f8667f0334
Save Krea2 even if quantized
2026-06-28 06:03:37 -06:00
Jaret Burkett
4a99ddabad
Fix breaking change with diffusers qwen image
2026-06-26 10:04:35 -06:00
Jaret Burkett
5f04ae7ad5
Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning.
2026-06-25 13:19:38 -06:00
Jaret Burkett
7a089fd0d7
Add support for training directly on Krea2 Turbo with a training adapter
2026-06-23 20:32:02 -06:00
Jaret Burkett
a803611ec1
Enable tiling on vae when decoding with low_vram flag on krea2
2026-06-23 18:38:52 -06:00
Jaret Burkett
724e67d634
Set krea 2 to use new lokr format
2026-06-23 13:31:50 -06:00
Jaret Burkett
e20b42e84a
Add offloading support for krea2
2026-06-23 10:43:36 -06:00
Jaret Burkett (Ostris)
99be3d96a2
Add support for Krea2 ( #906 )
...
* Add support for krea2
* Update repo pointer to actual repo
2026-06-23 09:18:14 -06:00
Jaret Burkett
60c1ac6a50
Add support for Boogu Image and Boogu Image Edit
2026-06-18 15:05:49 -06:00
Jaret Burkett
e886745051
Added additional information on addine new models and some additional gotchas
2026-06-18 15:04:50 -06:00
Jaret Burkett
ad49d4ef25
Update example to cover some common issues
2026-06-18 07:54:37 -06:00
Jaret Burkett
92814f9e6d
Apply ideogram dynamic shifting to sampling
2026-06-16 18:52:16 -06:00
Jaret Burkett
178eb5fbbe
Add unconditional lora support so Ideogram 4 inference will more closely resemble the full pipeline results. I pushed a finetuned unconditional lora to the hub as an adapter.
2026-06-16 13:27:43 -06:00
Jaret Burkett
f6c0104f25
Handle unconditional conditioning for ideogram 4 more in line with example code.
2026-06-16 10:23:08 -06:00
Jaret Burkett
86b19589a0
Update the Ideogram 4 prompt generation/parsing/ui to handle the updated format notes better.
2026-06-16 09:44:38 -06:00
Jaret Burkett
fcccc0fbd2
Add gradient checkpointing to ideogram4 vae
2026-06-15 10:00:40 -06:00
Jaret Burkett
c0d600b5d6
Allow using flash backend for ideogram
2026-06-13 15:17:20 -06:00
Jaret Burkett
c8cd78b1a4
Allow nested transformer block names for quantization, lora targeting, quantizing
2026-06-13 14:33:16 -06:00
Jaret Burkett
6c3b82696e
Add support for PRX Pixel T2I
2026-06-13 09:47:53 -06:00
Jaret Burkett
a01c83073a
Added an example model with docs so people and agents can add models easier.
2026-06-13 08:17:06 -06:00
Jaret Burkett
35588726de
Fixed issue where a buffer was stuck on cpu when offloading ideogram4
2026-06-07 13:31:03 -06:00
Jaret Burkett
8968e41234
Set ideogram to use new loke saving format
2026-06-07 09:49:57 -06:00
Jaret Burkett
6a8d9333b6
Improved the prompt handeling of ideogram4 model. Now used advanced prompts class to store them smaller and allow longer prompts
2026-06-04 13:00:23 -06:00
Jaret Burkett
63b3181262
Added experimental support for Ideogram 4
2026-06-04 09:03:00 -06:00
Jaret Burkett
5e84bf0d0b
Fixed issue with hidream-01 that could cause a weird nan state. Took forever to track down as it was 1 in 10 starts.
2026-05-28 12:48:24 -06:00
Jaret Burkett
ef57c1077c
Change z image divisibility
2026-05-28 09:09:36 -06:00
Jaret Burkett
7354def271
Added decode latent method to qwen image model
2026-05-25 10:02:09 -06:00
Jaret Burkett
fbac1cb7f5
Dont force flash attention on hidream 01. Causes random issues and is slower.
2026-05-24 16:05:22 -06:00
Jaret Burkett
644a6f9246
Fix device casting for zimage in some instances
2026-05-23 10:37:33 -06:00
Jaret Burkett
c6ecc03ccd
Fixed saving full model of z_image l2p for finetuning
2026-05-23 07:36:24 -06:00
Jaret Burkett
6102370df9
Add support for ZImage L2P
2026-05-22 14:58:28 -06:00
