github/ai-toolkit
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
1,460 Commits 9 Branches 0 Tags
da79ebce991c16bc6d343348085d0f7173e367ab
Commit Graph

221 Commits

Author SHA1 Message Date
Jaret Burkett
da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett
8a912564ce Fix video DOP methods 2026-08-26 10:05:14 -06:00
Jaret Burkett
127d6f626d Rework img/video reference in Minimax H3 to more closely match the comfy ui implementation. 2026-08-15 07:13:54 -06:00
Jaret Burkett
97bf49edad Add support for video references in MiniMax H3 ref2va 2026-08-15 06:18:09 -06:00
Jaret Burkett
5261d3fcca Add checkpointing to the Wan2.1 encoder 2026-08-14 07:31:16 -06:00
Jaret Burkett
8502a845b1 Add support for MiniMax H3 T2V and I2V training 2026-08-03 10:17:39 -06:00
Jaret Burkett
5baa495585 DFE optimizations 2026-08-01 10:06:16 -06:00
Jaret Burkett
fb204b7677 Fixed for DFEs with pixelspace and video models 2026-07-27 11:12:02 -06:00
Jaret Burkett
efb58c8641 Switch to thumbnails and thumbnail creation on the sample grid page until clicked. 2026-07-25 08:40:33 -06:00
Jaret Burkett
d5612dd35c Adjust the x0 of some DFEs 2026-07-22 10:38:40 -06:00
Zironic
a0224793ce Restore device runtime scales for compiled adapters (#963) 
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
 2026-07-18 08:19:57 -06:00
Jaret Burkett
6696117a94 Fix issue where the log lone for samples would double up sometimes 2026-07-17 08:11:32 -06:00
PlagueKind
3c75735ba2 remove unicode (#955) 2026-07-16 16:20:16 -06:00
Jaret Burkett
5fbfb502b5 Leave the generating samples bar in the log when samples finish. 2026-07-16 12:00:45 -06:00
Zironic
4ece17b71f Fix adapter scalar handling under torch.compile (#946) 
* Fix adapter scalar handling under torch.compile

* Fix instance where error could happen when merging in a lora to the base model

---------

Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:07:55 -06:00
PlagueKind
e44c34a955 fix lokr speed and convrot compile (#945) 2026-07-15 10:46:30 -06:00
Jaret Burkett
0d53e5e1f9 Fix compile with lokr on convrot 2026-07-13 19:24:57 -06:00
Jaret Burkett
a5f857ddb0 Added patch from Fatalis to fix lokr offloading with convrot 2026-07-13 18:48:56 -06:00
Jaret Burkett
28f2c0acbe Move z_image over to the new modeling class 2026-07-13 17:12:30 -06:00
Jaret Burkett
4625406093 WIP working on convrot offloading 2026-07-11 15:37:28 -06:00
Jaret Burkett
1d1e21177a Add ostris linear layer to linear layer searches. 2026-07-11 14:21:16 -06:00
Jaret Burkett
71c75357eb Add cached conditioning recovery to wan 22 5b model 2026-07-10 10:22:24 -06:00
Jaret Burkett
886c2aec57 Allow for vae tiling onle without low vram on wan models with a model kwarg 2026-07-10 09:42:52 -06:00
Jaret Burkett
883d60eb71 Do vae tiling when decoding wan models with low vram active. 2026-07-10 08:02:32 -06:00
Jaret Burkett
5f04ae7ad5 Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning. 2026-06-25 13:19:38 -06:00
Jaret Burkett
d14f6e567a Allow individual models to scale the loss after it is calculated. 2026-06-25 10:13:58 -06:00
Jaret Burkett
af594061ab Add ability to do hidden states with tipsv2 2026-06-22 11:00:04 -06:00
Jaret Burkett
820d534d6e Add features for models that may need a non masked loss such as inpainiting. 2026-06-22 10:59:17 -06:00
Jaret Burkett
6a8d9333b6 Improved the prompt handeling of ideogram4 model. Now used advanced prompts class to store them smaller and allow longer prompts 2026-06-04 13:00:23 -06:00
Jaret Burkett
d9f26c2f87 Add gradient checkpointing to tipsv2 heads 2026-06-01 05:00:15 -06:00
Jaret Burkett
e5439509b5 Added pure lpips dfe 2026-05-31 11:52:03 -06:00
Jaret Burkett
aecd554128 Add sapiens2 matting as a mask generator. Begin transition to model paths and model folders. 2026-05-20 08:56:16 -06:00
Jaret Burkett
4bfe944792 Scale dfe 7 with velocity_equiv_weight 2026-05-13 09:06:59 -06:00
Jaret Burkett
f38de2a2fe Add tipsv2 locally and fix gradient checkpointing for it 2026-05-10 14:47:44 -06:00
Jaret Burkett
a12ddd72a1 Change the velocity weight cap on dfe 9 2026-05-07 07:37:05 -06:00
Jaret Burkett
963a9f42b2 Add decode latent to wan 2.1 models. Add gradinet checkpointing to wan vae. 2026-05-05 11:30:16 -06:00
Jaret Burkett
acc6a36214 Scale DFE 9 to a velocity equiv weight to match flow matching gradient strength. Probably need to rework all DFEs to do this as the math checks out. 2026-04-28 09:10:02 -06:00
Jaret Burkett
1fc4ad3979 Add sapiens2 as a diffusion feature extractor 2026-04-27 15:59:03 -06:00
Jaret Burkett
488878f354 Use hidden layers in the loss for DFE 7 and 8 2026-04-18 13:07:38 -06:00
Jaret Burkett
beb40ae29b Add DFE8 with partial step 2026-04-17 17:40:16 -06:00
Jaret Burkett
ab1ee4df34 Hotfix some issues with Wan models caused by diffusers and transformers updates 2026-04-16 20:53:50 +00:00
Jaret Burkett
233e292256 Added some experimental low step things for zeta 2026-04-13 09:37:34 -06:00
Jaret Burkett
78cf049c29 Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. (#785) 
* Base ace step 1.5 xl added. Generating, still wip on training and ui

* Base training code done

* Fix some issues with caching text embeddings. Update sample cards to show audio

* Fix issue with quantizing ace step

* Add album artwork to samples with waveform.

* Cleanup logs

* Add album art endpoint to speed up album art loading

* Made an make video with artwork script

* Make ui handle basic audio models. Make multi line adjustments to the editor and better syntax hilighting.

* Add prompt tagging system for special tagged models.

* prompt tagging processing for ui working.

* Moved default samples to a special file so we can add more when needed and they can be adjusted for a specific model

* Add a captioner job with music captioner that is prepped for use with the ui

* Add basit ui setup for captioning modal and handeling captioning jobs

* Starting captioning job from ui working. Still better management for it.

* Better filtering of job options in the job view for captioning jobs

* Added qwen3 vl as a captioner for images

* Have an indicator when a dataset is being captioned.

* Adjust the way caption jobs look in the queue

* Fix a few issues. Adjust defaults.

* Version bump

* Added ace step to the readme.
 2026-04-09 15:02:03 -06:00
Jaret Burkett
171535833a Add Mac OS support for Apple Silicon (#770) 
* Made an install script and auto updates env for mac

* GPU sensors and initial training working for MAC. Still WIP.

* Switch dataloader to single threaded until I can work around some mac pickeling issues.

* Get quantization working on mac

* Fix mac exclusive imports so they don't break other builds.

* Add mac instructions to the UI
 2026-03-30 09:37:47 -06:00
Jaret Burkett
f85bf065bf Use pooler embeddings for DFE v6 with dino v3 2026-03-27 07:02:07 -06:00
Jaret Burkett
5642b656b9 Fix audio issues with ltx2 models. Silent codec fails now raised. Auto convert surround sound audio to stereo. Invalidate old caches just to be safe so they recache now. 2026-03-23 20:08:33 +00:00
Jaret Burkett
b04c64e0f8 Add a dino version of DFE 2026-03-04 08:20:37 -07:00
Jaret Burkett
3632656cda make DFE work with more VAEs 2026-02-18 09:46:37 -07:00
Jaret Burkett
115f0a3670 Fixed error with wan models when caching text embeddings 2026-02-06 14:26:53 -07:00
Jaret Burkett
1ce2428722 Shrink text embeds to max token length for LTX-2. Drastically reduces cached text embedding sizes 2026-01-28 12:54:49 -07:00