github/ai-toolkit
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
1,301 Commits 9 Branches 0 Tags
b6f334e676eb2be1a679da044ca88cf3a9fce781
Commit Graph

704 Commits

Author SHA1 Message Date
Jaret Burkett
bbaef7852a Do not materalize weights on ostris quantizer when getting state dict. Require dequantization of weight like other quantization methods. 2026-07-16 08:55:51 -06:00
Jaret Burkett
e1e1996c16 Rework the logging and terminal emulator on the ui to work like an actual emulator for better output. 2026-07-16 08:50:40 -06:00
rmatif
3e6bd874c4 feat: Add Anima support (#860) 
* Add Anima training support

* Update Anima modular training

* Use sample guidance for Anima

* Fix Anima sampling

* Limit Anima LoRA targets

* Convert Anima LoRA exports

* Fix Anima local loading

* Update Anima default model

* Pin upstream Anima diffusers

* Adjust template defaults to be consistent with other models. Update README

---------

Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com>
 2026-07-15 11:59:01 -06:00
fatalis
8bbd051667 Add sample_start_step setting to configure when sampling starts (#949) 
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:15:50 -06:00
Zironic
4ece17b71f Fix adapter scalar handling under torch.compile (#946) 
* Fix adapter scalar handling under torch.compile

* Fix instance where error could happen when merging in a lora to the base model

---------

Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:07:55 -06:00
PlagueKind
e44c34a955 fix lokr speed and convrot compile (#945) 2026-07-15 10:46:30 -06:00
Jaret Burkett
e28727d5cb Made a fused GEMV kernel for convrot unpacking to increase speed further. Fix bug in test script that made train time add additional grads to bf16. 2026-07-15 10:24:52 -06:00
Jaret Burkett
cf0db39ede Fix some errors for specific quants. Enable saving quantizations. 2026-07-14 07:25:09 -06:00
Jaret Burkett
0d53e5e1f9 Fix compile with lokr on convrot 2026-07-13 19:24:57 -06:00
Jaret Burkett
a5f857ddb0 Added patch from Fatalis to fix lokr offloading with convrot 2026-07-13 18:48:56 -06:00
Jaret Burkett
28f2c0acbe Move z_image over to the new modeling class 2026-07-13 17:12:30 -06:00
Jaret Burkett
28b05ee4ed Added convrotbitnet 1.58 bit quantization 2026-07-13 07:52:48 -06:00
Jaret Burkett
b6ff367633 Convrot improvements. Add argitrary bit packed byte quantizations. 2026-07-13 06:33:54 -06:00
Jaret Burkett
4625406093 WIP working on convrot offloading 2026-07-11 15:37:28 -06:00
Jaret Burkett
1d1e21177a Add ostris linear layer to linear layer searches. 2026-07-11 14:21:16 -06:00
Jaret Burkett
095d6e7418 Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods. 2026-07-11 13:49:41 -06:00
Jaret Burkett
933ca1c517 Apply w8a8 on the forward when training with convrot for more speed. Fix issue where quantizing a model had a pin memory leak. 2026-07-11 10:53:50 -06:00
Jaret Burkett
065ac27353 Fix issue with compiling convrot on some models 2026-07-11 09:26:12 -06:00
Jaret Burkett
96a3a06111 Added initial experimental support for convrot4 and convrot8 quantization. 2026-07-10 11:01:14 -06:00
Jaret Burkett
6fac83d068 Fix casting issue with orbit quant 2026-07-10 10:23:38 -06:00
Jaret Burkett
71c75357eb Add cached conditioning recovery to wan 22 5b model 2026-07-10 10:22:24 -06:00
Jaret Burkett
886c2aec57 Allow for vae tiling onle without low vram on wan models with a model kwarg 2026-07-10 09:42:52 -06:00
Jaret Burkett
883d60eb71 Do vae tiling when decoding wan models with low vram active. 2026-07-10 08:02:32 -06:00
Jaret Burkett
5a9b5bde3f Added experimental orbit quant 2026-07-09 15:14:51 -06:00
Jaret Burkett
dd08579eda Add ability to pull control images from same folder group 2026-07-08 05:21:31 -06:00
Jaret Burkett
b1e1a834d4 Added support to train Krea2 as an edit model 2026-07-04 09:12:39 -06:00
Jaret Burkett
ad87aacec0 Add ability to set certain layers to full for loras 2026-06-26 13:01:48 -06:00
Jaret Burkett
5f04ae7ad5 Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning. 2026-06-25 13:19:38 -06:00
Jaret Burkett
6ecff36f26 Add a way to do full rank lora modules of non lora layers such as embeddings, norm, etc 2026-06-25 11:55:07 -06:00
Jaret Burkett
4eb0707639 Add a control generation script. 2026-06-25 10:14:24 -06:00
Jaret Burkett
d14f6e567a Allow individual models to scale the loss after it is calculated. 2026-06-25 10:13:58 -06:00
PlagueKind
089e41dd1c Compile improvements - auto cache size, fix fullgraph setting, fix triton detection (#899) 
* Compile improvements - auto cache size, fix fullgraph setting, fix triton detection

* remove forced torchao no longer needed
 2026-06-24 07:59:41 -06:00
fatalis
d586125b40 Force HF downloads to show progress bars when output is not a TTY (#909) 2026-06-24 07:55:38 -06:00
Jaret Burkett
af594061ab Add ability to do hidden states with tipsv2 2026-06-22 11:00:04 -06:00
Jaret Burkett
820d534d6e Add features for models that may need a non masked loss such as inpainiting. 2026-06-22 10:59:17 -06:00
Jaret Burkett
c133c55cf5 Fix issue with mask generator revision 2026-06-22 08:19:27 -06:00
Jaret Burkett
d51463ca52 Add ability to recover from a truncated image file in the dataset 2026-06-22 05:07:30 -06:00
Jaret Burkett
ba0b3dbb65 Force batch size when bucket is too small by duplicating items in the batch 2026-06-21 20:01:29 -06:00
Jaret Burkett
99f8fd44e3 Add a fallback bbox adjustment when json parsing fails on ideogram4 captioner 2026-06-19 07:25:54 -06:00
Jaret Burkett
60c1ac6a50 Add support for Boogu Image and Boogu Image Edit 2026-06-18 15:05:49 -06:00
Jaret Burkett
178eb5fbbe Add unconditional lora support so Ideogram 4 inference will more closely resemble the full pipeline results. I pushed a finetuned unconditional lora to the hub as an adapter. 2026-06-16 13:27:43 -06:00
Jaret Burkett
86b19589a0 Update the Ideogram 4 prompt generation/parsing/ui to handle the updated format notes better. 2026-06-16 09:44:38 -06:00
Jaret Burkett
c730d64478 Added a flag to keep loading the image when latents are cached. Useful for DFE and other methods that target pixelspace losses. 2026-06-15 05:31:48 -06:00
Jaret Burkett
c8cd78b1a4 Allow nested transformer block names for quantization, lora targeting, quantizing 2026-06-13 14:33:16 -06:00
Jaret Burkett
2f91db8363 Defauly to compiling full graph to false 2026-06-13 07:28:51 -06:00
PlagueKind
e908d85f5e Allow quantized unet offload compile and force fullgraph false (#881) 2026-06-13 07:27:28 -06:00
Jaret Burkett
d83f7dd4d9 Fix a few issues with compile. Changed defaults. Future proofed block layer compile. 2026-06-12 11:43:43 -06:00
PlagueKind
6b1f89f30b Enhanced torch.compile System with Block-Level Compilation and Unified Whole-Model Fallback (#866) 
* Add block-level compile and qcompile torch.compile whole model  modes

* Update torch compile system
 2026-06-12 10:35:12 -06:00
Jaret Burkett
55ce6570f2 Automagic 3 rework. Stable in my testing. 2026-06-12 07:52:44 -06:00
Jaret Burkett
01b6a9806b Another complete rework of automagic3. Added a decay to the LR spread to the mean to prevent LRs fighting with eachother 2026-06-09 12:08:45 -06:00