github/ai-toolkit
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
1,370 Commits 9 Branches 0 Tags
bf739ff966c9c562f34c2208bd1749afa5980068
Commit Graph

733 Commits

Author SHA1 Message Date
Jaret Burkett
bf739ff966 Fix issue with layer offloading with MinMax H3 2026-08-03 11:32:36 -06:00
Jaret Burkett
8502a845b1 Add support for MiniMax H3 T2V and I2V training 2026-08-03 10:17:39 -06:00
Jaret Burkett
73cab2acf5 Reworked merge in out of loras with convrot weights for better roundtrip accuracy. 2026-08-02 08:29:17 -06:00
Jaret Burkett
a6f6b6b896 Fixed experiment opt name match 2026-08-01 17:43:36 -06:00
Jaret Burkett
6b95282097 Recover from issue when a video model first fram may not have been cached properly 2026-08-01 12:00:33 -06:00
Jaret Burkett
5baa495585 DFE optimizations 2026-08-01 10:06:16 -06:00
Jaret Burkett
c68e58083f Add code for automagic experiment 2026-08-01 10:04:46 -06:00
Jaret Burkett
497014bf5d Set i2v to default to false when omitted from the config 2026-07-31 19:11:58 -06:00
Jaret Burkett
7b2386c096 Handle video codecs that fail in opencv 2026-07-29 21:01:57 -06:00
Jaret Burkett
9021caa723 Merge branch 'dev' of github.com:ostris/ai-toolkit into dev 2026-07-29 17:50:50 -06:00
Jaret Burkett
3f8afcac7e Allow dataloader to encode first frame with the text embeddings if the model needs it. 2026-07-29 17:50:45 -06:00
Jaret Burkett
3d472de2f1 Reworked spawning on dataloader so windows and mac can use multiple data loader workers now 2026-07-29 17:47:04 -06:00
Jaret Burkett
c3afd95cc4 Improvements for mps convrot quants 2026-07-28 12:11:19 -06:00
Jaret Burkett
461e798708 Rework windows start and stop methods so that command windows dont appear. Stop with signal since we cannot signint. 2026-07-27 17:43:01 -06:00
Jaret Burkett
7e7053fc9a Remove k-sampler requirement and remove it form the cold. not used anymore anyway 2026-07-27 14:58:31 -06:00
Jaret Burkett
b677cdb026 Move uintx quantization to ostris quant with bit identical matching. Now we are not bound to an older version of torch ao. 2026-07-27 12:59:42 -06:00
Jaret Burkett
fb204b7677 Fixed for DFEs with pixelspace and video models 2026-07-27 11:12:02 -06:00
Jaret Burkett
0c3a5e6970 Default to lokr full rank when not passed. 2026-07-25 09:06:49 -06:00
Jaret Burkett
efb58c8641 Switch to thumbnails and thumbnail creation on the sample grid page until clicked. 2026-07-25 08:40:33 -06:00
Jaret Burkett
8f2d001eae Improvements to video frame loading. Added ability to cache as uint8 pixelspace for video 2026-07-24 12:36:47 -06:00
Jaret Burkett
d5612dd35c Adjust the x0 of some DFEs 2026-07-22 10:38:40 -06:00
Jaret Burkett
1eb97b7443 Added validation loss 2026-07-19 19:33:45 -06:00
Zironic
a0224793ce Restore device runtime scales for compiled adapters (#963) 
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
 2026-07-18 08:19:57 -06:00
Jaret Burkett
cfdc9033a6 Add min and max LR or automagic to prefent runaway edge cases. 2026-07-17 14:19:53 -06:00
Jaret Burkett
f1bc6508ad Fix issue with qwen image edit models. 2026-07-17 09:14:04 -06:00
Jaret Burkett
6696117a94 Fix issue where the log lone for samples would double up sometimes 2026-07-17 08:11:32 -06:00
PlagueKind
3c75735ba2 remove unicode (#955) 2026-07-16 16:20:16 -06:00
Jaret Burkett
5fbfb502b5 Leave the generating samples bar in the log when samples finish. 2026-07-16 12:00:45 -06:00
Jaret Burkett
e805389f1e Remove print buffer. Add new line after sampling. 2026-07-16 11:37:23 -06:00
Jaret Burkett
bbaef7852a Do not materalize weights on ostris quantizer when getting state dict. Require dequantization of weight like other quantization methods. 2026-07-16 08:55:51 -06:00
Jaret Burkett
e1e1996c16 Rework the logging and terminal emulator on the ui to work like an actual emulator for better output. 2026-07-16 08:50:40 -06:00
rmatif
3e6bd874c4 feat: Add Anima support (#860) 
* Add Anima training support

* Update Anima modular training

* Use sample guidance for Anima

* Fix Anima sampling

* Limit Anima LoRA targets

* Convert Anima LoRA exports

* Fix Anima local loading

* Update Anima default model

* Pin upstream Anima diffusers

* Adjust template defaults to be consistent with other models. Update README

---------

Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com>
 2026-07-15 11:59:01 -06:00
fatalis
8bbd051667 Add sample_start_step setting to configure when sampling starts (#949) 
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:15:50 -06:00
Zironic
4ece17b71f Fix adapter scalar handling under torch.compile (#946) 
* Fix adapter scalar handling under torch.compile

* Fix instance where error could happen when merging in a lora to the base model

---------

Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:07:55 -06:00
PlagueKind
e44c34a955 fix lokr speed and convrot compile (#945) 2026-07-15 10:46:30 -06:00
Jaret Burkett
e28727d5cb Made a fused GEMV kernel for convrot unpacking to increase speed further. Fix bug in test script that made train time add additional grads to bf16. 2026-07-15 10:24:52 -06:00
Jaret Burkett
cf0db39ede Fix some errors for specific quants. Enable saving quantizations. 2026-07-14 07:25:09 -06:00
Jaret Burkett
0d53e5e1f9 Fix compile with lokr on convrot 2026-07-13 19:24:57 -06:00
Jaret Burkett
a5f857ddb0 Added patch from Fatalis to fix lokr offloading with convrot 2026-07-13 18:48:56 -06:00
Jaret Burkett
28f2c0acbe Move z_image over to the new modeling class 2026-07-13 17:12:30 -06:00
Jaret Burkett
28b05ee4ed Added convrotbitnet 1.58 bit quantization 2026-07-13 07:52:48 -06:00
Jaret Burkett
b6ff367633 Convrot improvements. Add argitrary bit packed byte quantizations. 2026-07-13 06:33:54 -06:00
Jaret Burkett
4625406093 WIP working on convrot offloading 2026-07-11 15:37:28 -06:00
Jaret Burkett
1d1e21177a Add ostris linear layer to linear layer searches. 2026-07-11 14:21:16 -06:00
Jaret Burkett
095d6e7418 Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods. 2026-07-11 13:49:41 -06:00
Jaret Burkett
933ca1c517 Apply w8a8 on the forward when training with convrot for more speed. Fix issue where quantizing a model had a pin memory leak. 2026-07-11 10:53:50 -06:00
Jaret Burkett
065ac27353 Fix issue with compiling convrot on some models 2026-07-11 09:26:12 -06:00
Jaret Burkett
96a3a06111 Added initial experimental support for convrot4 and convrot8 quantization. 2026-07-10 11:01:14 -06:00
Jaret Burkett
6fac83d068 Fix casting issue with orbit quant 2026-07-10 10:23:38 -06:00
Jaret Burkett
71c75357eb Add cached conditioning recovery to wan 22 5b model 2026-07-10 10:22:24 -06:00