github/ai-toolkit
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
1,345 Commits 9 Branches 0 Tags
038270eb2facd18652a101ad883dee2dbb81039b
Commit Graph

720 Commits

Author SHA1 Message Date
Jaret Burkett
461e798708 Rework windows start and stop methods so that command windows dont appear. Stop with signal since we cannot signint. 2026-07-27 17:43:01 -06:00
Jaret Burkett
7e7053fc9a Remove k-sampler requirement and remove it form the cold. not used anymore anyway 2026-07-27 14:58:31 -06:00
Jaret Burkett
b677cdb026 Move uintx quantization to ostris quant with bit identical matching. Now we are not bound to an older version of torch ao. 2026-07-27 12:59:42 -06:00
Jaret Burkett
fb204b7677 Fixed for DFEs with pixelspace and video models 2026-07-27 11:12:02 -06:00
Jaret Burkett
0c3a5e6970 Default to lokr full rank when not passed. 2026-07-25 09:06:49 -06:00
Jaret Burkett
efb58c8641 Switch to thumbnails and thumbnail creation on the sample grid page until clicked. 2026-07-25 08:40:33 -06:00
Jaret Burkett
8f2d001eae Improvements to video frame loading. Added ability to cache as uint8 pixelspace for video 2026-07-24 12:36:47 -06:00
Jaret Burkett
d5612dd35c Adjust the x0 of some DFEs 2026-07-22 10:38:40 -06:00
Jaret Burkett
1eb97b7443 Added validation loss 2026-07-19 19:33:45 -06:00
Zironic
a0224793ce Restore device runtime scales for compiled adapters (#963) 
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
 2026-07-18 08:19:57 -06:00
Jaret Burkett
cfdc9033a6 Add min and max LR or automagic to prefent runaway edge cases. 2026-07-17 14:19:53 -06:00
Jaret Burkett
f1bc6508ad Fix issue with qwen image edit models. 2026-07-17 09:14:04 -06:00
Jaret Burkett
6696117a94 Fix issue where the log lone for samples would double up sometimes 2026-07-17 08:11:32 -06:00
PlagueKind
3c75735ba2 remove unicode (#955) 2026-07-16 16:20:16 -06:00
Jaret Burkett
5fbfb502b5 Leave the generating samples bar in the log when samples finish. 2026-07-16 12:00:45 -06:00
Jaret Burkett
e805389f1e Remove print buffer. Add new line after sampling. 2026-07-16 11:37:23 -06:00
Jaret Burkett
bbaef7852a Do not materalize weights on ostris quantizer when getting state dict. Require dequantization of weight like other quantization methods. 2026-07-16 08:55:51 -06:00
Jaret Burkett
e1e1996c16 Rework the logging and terminal emulator on the ui to work like an actual emulator for better output. 2026-07-16 08:50:40 -06:00
rmatif
3e6bd874c4 feat: Add Anima support (#860) 
* Add Anima training support

* Update Anima modular training

* Use sample guidance for Anima

* Fix Anima sampling

* Limit Anima LoRA targets

* Convert Anima LoRA exports

* Fix Anima local loading

* Update Anima default model

* Pin upstream Anima diffusers

* Adjust template defaults to be consistent with other models. Update README

---------

Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com>
 2026-07-15 11:59:01 -06:00
fatalis
8bbd051667 Add sample_start_step setting to configure when sampling starts (#949) 
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:15:50 -06:00
Zironic
4ece17b71f Fix adapter scalar handling under torch.compile (#946) 
* Fix adapter scalar handling under torch.compile

* Fix instance where error could happen when merging in a lora to the base model

---------

Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:07:55 -06:00
PlagueKind
e44c34a955 fix lokr speed and convrot compile (#945) 2026-07-15 10:46:30 -06:00
Jaret Burkett
e28727d5cb Made a fused GEMV kernel for convrot unpacking to increase speed further. Fix bug in test script that made train time add additional grads to bf16. 2026-07-15 10:24:52 -06:00
Jaret Burkett
cf0db39ede Fix some errors for specific quants. Enable saving quantizations. 2026-07-14 07:25:09 -06:00
Jaret Burkett
0d53e5e1f9 Fix compile with lokr on convrot 2026-07-13 19:24:57 -06:00
Jaret Burkett
a5f857ddb0 Added patch from Fatalis to fix lokr offloading with convrot 2026-07-13 18:48:56 -06:00
Jaret Burkett
28f2c0acbe Move z_image over to the new modeling class 2026-07-13 17:12:30 -06:00
Jaret Burkett
28b05ee4ed Added convrotbitnet 1.58 bit quantization 2026-07-13 07:52:48 -06:00
Jaret Burkett
b6ff367633 Convrot improvements. Add argitrary bit packed byte quantizations. 2026-07-13 06:33:54 -06:00
Jaret Burkett
4625406093 WIP working on convrot offloading 2026-07-11 15:37:28 -06:00
Jaret Burkett
1d1e21177a Add ostris linear layer to linear layer searches. 2026-07-11 14:21:16 -06:00
Jaret Burkett
095d6e7418 Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods. 2026-07-11 13:49:41 -06:00
Jaret Burkett
933ca1c517 Apply w8a8 on the forward when training with convrot for more speed. Fix issue where quantizing a model had a pin memory leak. 2026-07-11 10:53:50 -06:00
Jaret Burkett
065ac27353 Fix issue with compiling convrot on some models 2026-07-11 09:26:12 -06:00
Jaret Burkett
96a3a06111 Added initial experimental support for convrot4 and convrot8 quantization. 2026-07-10 11:01:14 -06:00
Jaret Burkett
6fac83d068 Fix casting issue with orbit quant 2026-07-10 10:23:38 -06:00
Jaret Burkett
71c75357eb Add cached conditioning recovery to wan 22 5b model 2026-07-10 10:22:24 -06:00
Jaret Burkett
886c2aec57 Allow for vae tiling onle without low vram on wan models with a model kwarg 2026-07-10 09:42:52 -06:00
Jaret Burkett
883d60eb71 Do vae tiling when decoding wan models with low vram active. 2026-07-10 08:02:32 -06:00
Jaret Burkett
5a9b5bde3f Added experimental orbit quant 2026-07-09 15:14:51 -06:00
Jaret Burkett
dd08579eda Add ability to pull control images from same folder group 2026-07-08 05:21:31 -06:00
Jaret Burkett
b1e1a834d4 Added support to train Krea2 as an edit model 2026-07-04 09:12:39 -06:00
Jaret Burkett
ad87aacec0 Add ability to set certain layers to full for loras 2026-06-26 13:01:48 -06:00
Jaret Burkett
5f04ae7ad5 Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning. 2026-06-25 13:19:38 -06:00
Jaret Burkett
6ecff36f26 Add a way to do full rank lora modules of non lora layers such as embeddings, norm, etc 2026-06-25 11:55:07 -06:00
Jaret Burkett
4eb0707639 Add a control generation script. 2026-06-25 10:14:24 -06:00
Jaret Burkett
d14f6e567a Allow individual models to scale the loss after it is calculated. 2026-06-25 10:13:58 -06:00
PlagueKind
089e41dd1c Compile improvements - auto cache size, fix fullgraph setting, fix triton detection (#899) 
* Compile improvements - auto cache size, fix fullgraph setting, fix triton detection

* remove forced torchao no longer needed
 2026-06-24 07:59:41 -06:00
fatalis
d586125b40 Force HF downloads to show progress bars when output is not a TTY (#909) 2026-06-24 07:55:38 -06:00
Jaret Burkett
af594061ab Add ability to do hidden states with tipsv2 2026-06-22 11:00:04 -06:00