Commit Graph

1474 Commits

Author SHA1 Message Date
Jaret Burkett
7602e476eb Exclude sensative layers from quantization in krea 2026-07-13 10:14:53 -06:00
Jaret Burkett
28b05ee4ed Added convrotbitnet 1.58 bit quantization 2026-07-13 07:52:48 -06:00
Jaret Burkett
a259fa07cd Make convrot ui clearer 2026-07-13 06:44:27 -06:00
Jaret Burkett
0b62e516cc Version Bump 2026-07-13 06:34:21 -06:00
Jaret Burkett
b6ff367633 Convrot improvements. Add argitrary bit packed byte quantizations. 2026-07-13 06:33:54 -06:00
Jaret Burkett
64663c8575 Add Boogu to the readme. 2026-07-11 21:03:00 -06:00
Jaret Burkett
4625406093 WIP working on convrot offloading 2026-07-11 15:37:28 -06:00
Jaret Burkett
1d1e21177a Add ostris linear layer to linear layer searches. 2026-07-11 14:21:16 -06:00
Jaret Burkett
095d6e7418 Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods. 2026-07-11 13:49:41 -06:00
Jaret Burkett
933ca1c517 Apply w8a8 on the forward when training with convrot for more speed. Fix issue where quantizing a model had a pin memory leak. 2026-07-11 10:53:50 -06:00
Jaret Burkett
065ac27353 Fix issue with compiling convrot on some models 2026-07-11 09:26:12 -06:00
Jaret Burkett
96a3a06111 Added initial experimental support for convrot4 and convrot8 quantization. 2026-07-10 11:01:14 -06:00
Jaret Burkett
6fac83d068 Fix casting issue with orbit quant 2026-07-10 10:23:38 -06:00
Jaret Burkett
71c75357eb Add cached conditioning recovery to wan 22 5b model 2026-07-10 10:22:24 -06:00
Jaret Burkett
ad07b06de5 Use cached first frame for wan22_5 model 2026-07-10 10:21:34 -06:00
Jaret Burkett
886c2aec57 Allow for vae tiling onle without low vram on wan models with a model kwarg 2026-07-10 09:42:52 -06:00
Jaret Burkett
fe82487187 Add tiling on vae decode for qwen image models when low vram flag is on 2026-07-10 09:07:29 -06:00
Jaret Burkett
e7951ad29e Exclude sensative layers from quantization on wan models 2026-07-10 08:56:05 -06:00
Jaret Burkett
883d60eb71 Do vae tiling when decoding wan models with low vram active. 2026-07-10 08:02:32 -06:00
Jaret Burkett
fed9357234 Fix ui to show kv cache for krea2 edit raw 2026-07-09 15:48:46 -06:00
Jaret Burkett
5a9b5bde3f Added experimental orbit quant 2026-07-09 15:14:51 -06:00
Jaret Burkett
a4bbe167ce Added reference token attention isolation (kv_cache) for Krea2 edit training. Same training cost with significant inference speed up. 2x inference speedup. 2026-07-09 12:00:55 -06:00
Jaret Burkett
6233efe1bb Fix sampling issue on zimage turbo and krea2 turbo models 2026-07-08 12:34:39 -06:00
Jaret Burkett
dd08579eda Add ability to pull control images from same folder group 2026-07-08 05:21:31 -06:00
Jaret Burkett
7bceec3b07 Apply a loss mask for first frame conditioning for wan and ltx 2026-07-07 09:05:53 -06:00
Jaret Burkett
bd93a312bc Load more types of comfy ui style quants for ltx2 2026-07-07 09:04:51 -06:00
Jaret Burkett
17bc302d13 Make log calls blocking to prevent duplicates. 2026-07-06 07:38:20 -06:00
Jaret Burkett
6c0d1c4679 Improve latency of the job list endpoint 2026-07-04 13:22:09 -06:00
Jaret Burkett
3a94591c89 Disable text encoder unload with krea2 o-edit 2026-07-04 09:17:15 -06:00
Jaret Burkett
b1e1a834d4 Added support to train Krea2 as an edit model 2026-07-04 09:12:39 -06:00
Jaret Burkett
f63221e577 Replace all sync functions with async to allow more parallel api calls 2026-07-01 17:12:43 -06:00
Jaret Burkett
48781f900b Improve the loading and transfer speed of the dataset file lists 2026-07-01 16:40:01 -06:00
Jaret Burkett
b36a8e9c4b Only pull the new log bytes from the ui to improve performance 2026-07-01 14:11:23 -06:00
Jaret Burkett
733e14cb58 Fix issue where the window would scroll to and hilight custom items in the select box 2026-07-01 13:57:56 -06:00
Jaret Burkett
4e50535478 Allow models to provide an additional loss 2026-06-28 09:49:36 -06:00
Jaret Burkett
1e12b6b73f Remove duplicate save when triggering save next step 2026-06-28 07:18:16 -06:00
Jaret Burkett
7ee1f98f6d Allow loading and saving z_image in comfy safetensors format. 2026-06-28 07:15:49 -06:00
Jaret Burkett
c97fc9973a Fix loading pretraied lora when merging network on save 2026-06-28 06:04:36 -06:00
Jaret Burkett
f8667f0334 Save Krea2 even if quantized 2026-06-28 06:03:37 -06:00
Jaret Burkett
df6ea4263d Version bump 2026-06-26 13:02:10 -06:00
Jaret Burkett
ad87aacec0 Add ability to set certain layers to full for loras 2026-06-26 13:01:48 -06:00
Jaret Burkett
4a99ddabad Fix breaking change with diffusers qwen image 2026-06-26 10:04:35 -06:00
Jaret Burkett
5f04ae7ad5 Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning. 2026-06-25 13:19:38 -06:00
Jaret Burkett
6ecff36f26 Add a way to do full rank lora modules of non lora layers such as embeddings, norm, etc 2026-06-25 11:55:07 -06:00
Jaret Burkett
4eb0707639 Add a control generation script. 2026-06-25 10:14:24 -06:00
Jaret Burkett
d14f6e567a Allow individual models to scale the loss after it is calculated. 2026-06-25 10:13:58 -06:00
Jaret Burkett
f743ccf7ef Save before last sample 2026-06-24 09:13:01 -06:00
PlagueKind
089e41dd1c Compile improvements - auto cache size, fix fullgraph setting, fix triton detection (#899)
* Compile improvements - auto cache size, fix fullgraph setting, fix triton detection

* remove forced torchao no longer needed
2026-06-24 07:59:41 -06:00
fatalis
d586125b40 Force HF downloads to show progress bars when output is not a TTY (#909) 2026-06-24 07:55:38 -06:00
Jaret Burkett
7a089fd0d7 Add support for training directly on Krea2 Turbo with a training adapter 2026-06-23 20:32:02 -06:00