github/ai-toolkit
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
1,485 Commits 9 Branches 0 Tags
main
Commit Graph

255 Commits

Author SHA1 Message Date
Jaret Burkett
764b5064fb Migrate to a new DTO for latents to carry more information that a normal tensor such as audio. 2026-08-30 10:30:21 -06:00
Jaret Burkett
da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett
27a03a91f2 Rework progress bar and ui speed string so it gets the same value at a more accurate and snappier wall clock time 2026-08-21 13:31:02 -06:00
Jaret Burkett
257da9b586 Rework DOP so it works with caching text embeddings 2026-08-09 22:13:49 -06:00
Jaret Burkett
8502a845b1 Add support for MiniMax H3 T2V and I2V training 2026-08-03 10:17:39 -06:00
Jaret Burkett
fc78b07332 Attach the ema to the base model so it can be used on specific models 2026-08-01 10:05:42 -06:00
Jaret Burkett
6e7bc81241 Allow random noise shift with video latents. 2026-07-31 05:58:08 -06:00
Jaret Burkett
088084e2c2 Resize validation images with the bucket sizing strategy. 2026-07-20 11:22:33 -06:00
Jaret Burkett
df354da23e Replace trigger word in validation prompts for [trigger] tags 2026-07-20 07:56:04 -06:00
Jaret Burkett
1eb97b7443 Added validation loss 2026-07-19 19:33:45 -06:00
Jaret Burkett
e805389f1e Remove print buffer. Add new line after sampling. 2026-07-16 11:37:23 -06:00
fatalis
8bbd051667 Add sample_start_step setting to configure when sampling starts (#949) 
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:15:50 -06:00
Jaret Burkett
095d6e7418 Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods. 2026-07-11 13:49:41 -06:00
Jaret Burkett
c97fc9973a Fix loading pretraied lora when merging network on save 2026-06-28 06:04:36 -06:00
Jaret Burkett
5f04ae7ad5 Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning. 2026-06-25 13:19:38 -06:00
Jaret Burkett
f743ccf7ef Save before last sample 2026-06-24 09:13:01 -06:00
PlagueKind
089e41dd1c Compile improvements - auto cache size, fix fullgraph setting, fix triton detection (#899) 
* Compile improvements - auto cache size, fix fullgraph setting, fix triton detection

* remove forced torchao no longer needed
 2026-06-24 07:59:41 -06:00
Jaret Burkett
c8cd78b1a4 Allow nested transformer block names for quantization, lora targeting, quantizing 2026-06-13 14:33:16 -06:00
PlagueKind
e908d85f5e Allow quantized unet offload compile and force fullgraph false (#881) 2026-06-13 07:27:28 -06:00
Jaret Burkett
43b22b91ee Add a triton check on compile 2026-06-12 12:26:16 -06:00
Jaret Burkett
10e50d5797 Fix issue with casting unet after compilation 2026-06-12 12:16:51 -06:00
Jaret Burkett
d83f7dd4d9 Fix a few issues with compile. Changed defaults. Future proofed block layer compile. 2026-06-12 11:43:43 -06:00
PlagueKind
6b1f89f30b Enhanced torch.compile System with Block-Level Compilation and Unified Whole-Model Fallback (#866) 
* Add block-level compile and qcompile torch.compile whole model  modes

* Update torch compile system
 2026-06-12 10:35:12 -06:00
Jaret Burkett
cac3815b2c Make DOP run in a single backward pass, should be faster and more stable. Show dop loss on ui 2026-06-08 13:55:47 -06:00
Jaret Burkett
82190b41e6 Fix bug where EMA was not being initialized even when setup in the config. EMA will now properly be setup and used. 2026-06-07 11:11:49 -06:00
Jaret Burkett
233e292256 Added some experimental low step things for zeta 2026-04-13 09:37:34 -06:00
Jaret Burkett
bfb373c8fa Prep for future breaking changes in newer versions of transformers library 2026-04-10 12:04:32 -06:00
Jaret Burkett
78cf049c29 Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. (#785) 
* Base ace step 1.5 xl added. Generating, still wip on training and ui

* Base training code done

* Fix some issues with caching text embeddings. Update sample cards to show audio

* Fix issue with quantizing ace step

* Add album artwork to samples with waveform.

* Cleanup logs

* Add album art endpoint to speed up album art loading

* Made an make video with artwork script

* Make ui handle basic audio models. Make multi line adjustments to the editor and better syntax hilighting.

* Add prompt tagging system for special tagged models.

* prompt tagging processing for ui working.

* Moved default samples to a special file so we can add more when needed and they can be adjusted for a specific model

* Add a captioner job with music captioner that is prepped for use with the ui

* Add basit ui setup for captioning modal and handeling captioning jobs

* Starting captioning job from ui working. Still better management for it.

* Better filtering of job options in the job view for captioning jobs

* Added qwen3 vl as a captioner for images

* Have an indicator when a dataset is being captioned.

* Adjust the way caption jobs look in the queue

* Fix a few issues. Adjust defaults.

* Version bump

* Added ace step to the readme.
 2026-04-09 15:02:03 -06:00
Jaret Burkett
0dcbabf6af Fix merge nertwork ref 2026-04-01 10:38:31 -06:00
Jaret Burkett
da2a79590f Add a merge network on save strength 2026-04-01 09:21:08 -06:00
Jaret Burkett
4a3251640a More work on compiling models 2026-03-31 12:11:56 -06:00
Jaret Burkett
358d684f6f Move compiiling the model after accelerate manipulation 2026-03-31 09:52:27 -06:00
Jaret Burkett
0045260af7 Fix issue where compile true did not actually compile the model 2026-03-31 09:27:54 -06:00
Jaret Burkett
171535833a Add Mac OS support for Apple Silicon (#770) 
* Made an install script and auto updates env for mac

* GPU sensors and initial training working for MAC. Still WIP.

* Switch dataloader to single threaded until I can work around some mac pickeling issues.

* Get quantization working on mac

* Fix mac exclusive imports so they don't break other builds.

* Add mac instructions to the UI
 2026-03-30 09:37:47 -06:00
Remix
7a0bbca5b1 Fix random_noise_multiplier (#738) 
Apply random_noise_multiplier to noise.
 2026-03-23 15:22:16 -06:00
Jaret Burkett
06ef3d343a add ability to use batch noise correction during training 2026-03-10 09:05:57 -06:00
Jaret Burkett
40f995f616 Add method to do continuious lora merging in for low vram full finetuning. 2026-02-26 09:00:41 -07:00
Jaret Burkett
a055947d56 Add signal_correction_noise_scale to config to scale the signal correction strength 2026-02-07 12:04:21 -07:00
Jaret Burkett
454722cc97 Add signal correction noise 2026-02-07 09:49:55 -07:00
Jaret Burkett
1422789452 Improved the method to augment random noise 2026-02-06 15:44:10 -07:00
Jaret Burkett
5c37db04f9 Added ability to activate experimental blank stabilization during training to zero out latents with blank prompts. 2026-02-04 13:00:03 -07:00
Jaret Burkett
a767b82b60 Fixed issue with new logger when ooming 2025-12-25 16:57:34 +00:00
Jaret Burkett
87edca1b2b Added initial support to initiate lora training from an existing lora 2025-12-22 12:49:15 -07:00
Jaret Burkett
ba00eea7d9 Add loss graph to the ui 2025-12-18 10:08:59 -07:00
Jaret Burkett
0d8a33dc16 Offload ARA with the layer if doing layer offloading. Add support to offload the LoRA. Still needs optimizer support 2025-10-21 06:03:27 -06:00
Jaret Burkett
76ce757e0c Added initial support for layer offloading wit Wan 2.2 14B models. 2025-10-20 14:54:30 -06:00
Jaret Burkett
1bc6dee127 Change auto_memory to be layer_offloading and allow you to set the amount to unload 2025-10-10 13:12:32 -06:00
Jaret Burkett
4e5707854f Initial support for RamTorch. Still a WIP 2025-10-05 13:03:26 -06:00
Jaret Burkett
3086a58e5b git status 2025-10-01 14:12:17 -06:00
Jaret Burkett
b07b88c46b Allow trigger when caching text embeddings since it is now passed to dataset 2025-09-30 16:58:35 -06:00