github/ai-toolkit
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
1,485 Commits 9 Branches 0 Tags
main
Commit Graph

781 Commits

Author SHA1 Message Date
Jaret Burkett
9d6a9a0803 Fixed embedding scale for offloading for ltx 2.3. Was a new bug added today.
Some checks failed
Close Stale Issues and PRs / close-stale (push) Has been cancelled
Details
2026-08-31 15:53:58 -06:00
Jaret Burkett
6940ebf533 Skip files where caching fails in a dataset instead of crashing. 2026-08-30 16:49:12 -06:00
Jaret Burkett
74ed5fddb0 Fix issue with ltx caching 2026-08-30 11:01:52 -06:00
Jaret Burkett
764b5064fb Migrate to a new DTO for latents to carry more information that a normal tensor such as audio. 2026-08-30 10:30:21 -06:00
Jaret Burkett
be995185f5 Fixed issue with offloading with new model loader on nvfp4 weights. 2026-08-29 12:01:40 -06:00
Jaret Burkett
683fe8afc0 Stability improvements to model offloading. Added D-OPSD bleed loss as well. 2026-08-29 11:23:47 -06:00
Jaret Burkett
7195abc32b Performance fixes and bug fixes 2026-08-28 22:21:09 -06:00
Jaret Burkett
5ddc5f8ca7 Optimize quantization path 2026-08-28 11:47:29 -06:00
Jaret Burkett
ce3df32101 Fix speed on wan conv patch 2026-08-28 10:54:26 -06:00
Jaret Burkett
92df289931 Fix quantization issues 2026-08-28 10:48:34 -06:00
Jaret Burkett
85a6880643 Move the offload and quantization to the base model 2026-08-28 08:37:56 -06:00
Jaret Burkett
702254688d Added legacy paths 2026-08-28 07:55:19 -06:00
Jaret Burkett
c3bc8b0b4e Full test of ui arch compatability 2026-08-28 06:56:05 -06:00
Jaret Burkett
520d96aac3 Phase 2 2026-08-27 18:18:31 -06:00
Jaret Burkett
45886f01b2 Phase 2 2026-08-27 16:16:35 -06:00
Jaret Burkett
9113420b61 Phase 2 2026-08-27 15:37:13 -06:00
Jaret Burkett
9ed2e0b8e7 Test model loading 2026-08-27 14:31:53 -06:00
Jaret Burkett
8db198ec0a Phase 1 2026-08-27 11:53:08 -06:00
Jaret Burkett
e8d9cf6d35 Models v2 - phase 0 2026-08-27 10:51:43 -06:00
Jaret Burkett
da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett
8a912564ce Fix video DOP methods 2026-08-26 10:05:14 -06:00
Jaret Burkett
27a03a91f2 Rework progress bar and ui speed string so it gets the same value at a more accurate and snappier wall clock time 2026-08-21 13:31:02 -06:00
Jaret Burkett
b96476a841 Allow overriding the batch size on a per dataset level 2026-08-21 12:56:04 -06:00
Jaret Burkett
afd1d92722 Fix issue with double sampling qwen vl video frames for hidream h3 for reference videos 2026-08-17 15:39:07 -06:00
Jaret Burkett
127d6f626d Rework img/video reference in Minimax H3 to more closely match the comfy ui implementation. 2026-08-15 07:13:54 -06:00
Jaret Burkett
97bf49edad Add support for video references in MiniMax H3 ref2va 2026-08-15 06:18:09 -06:00
Jaret Burkett
5261d3fcca Add checkpointing to the Wan2.1 encoder 2026-08-14 07:31:16 -06:00
Jaret Burkett
6b7fb60a22 Make contrastive guidance loss do constant instead of sigma loss schedule by default 2026-08-13 09:52:02 -06:00
Jaret Burkett
7f9a142dfd Generate thumbnails for dataset items so things load faster and the ui is more stable. Especially good for videos. 2026-08-12 20:33:42 -06:00
Jaret Burkett
a1ddeeef13 Fixed issue with offloading text encoder on ltx 2.5 2026-08-12 10:46:58 -06:00
Jaret Burkett
21dc65972d Only add a blank control if the model has to have it, for unconditionals. Previously it always encoded a blank control on unconditional if the model could take one. Affects DOP and blank prompt preservations. 2026-08-11 08:25:23 -06:00
Jaret Burkett
f421542df4 When dropping out, caching, and doing DOP, make sure we select a cahced trigger word when dropped out so DOP matches the drop out embeddings. 2026-08-11 06:59:20 -06:00
Jaret Burkett
ab5fef8970 Fix caption dropout so it now works identically when caching text embeddings. 2026-08-10 18:53:33 -06:00
Jaret Burkett
257da9b586 Rework DOP so it works with caching text embeddings 2026-08-09 22:13:49 -06:00
Jaret Burkett
72623ed3d6 When doing auto frame count. Ensure the time is not squeezed or expanded to fit tempooral spacing. trime the few extra frames. Also fixed frame counts of buckets. 2026-08-09 12:31:02 -06:00
Jaret Burkett
682b27c6ee Reworked freeing memory manager for removing text encoder completly when not needed. 2026-08-09 07:08:24 -06:00
Jaret Burkett
8c1a4082fd Allow images to work with auto frame count, and include images in video datasets if they exist. 2026-08-08 20:26:28 -06:00
Fitzy
d184c6c622 Fix offload buffer stream lifetime 2026-08-08 19:59:23 -04:00
Jaret Burkett
f4e9130547 Fix race condition that can corrupt grads under certain conditions. 2026-08-07 14:52:47 -06:00
Jaret Burkett
1e1418b22c Apply sigma to contrastive guidance to balance loss better. Prevent noise grads on images/non audio datasets. Prep for training adapters on MiniMax H3 2026-08-05 13:27:12 -06:00
Jaret Burkett
3afa270ab5 Fix audio losses for DOP and other preservation losses 2026-08-04 22:08:48 -06:00
Jaret Burkett
0f9094db95 Fix audio loss when doing do_guidance_loss 2026-08-04 21:43:31 -06:00
Jaret Burkett
d870e9b68a Fix backwards compatability for older versions of triton 2026-08-04 21:07:57 -06:00
Jaret Burkett
00a93e3830 Add dataset flag to cache the raw tensors 2026-08-04 15:32:48 -06:00
Jaret Burkett
8a0bcf1ffe Fix issue loading H3 test encoder on older GPUS 2026-08-04 15:30:29 -06:00
Jaret Burkett
a9a04547e9 Dont move encoders on and off device when caching until the first instance of needing to process a cache item. 2026-08-03 15:54:30 -06:00
Jaret Burkett
41676bb258 Queue up videos with multiple threads when caching latents so the VAE is not waiting on videos to process 2026-08-03 15:41:36 -06:00
Jaret Burkett
d3a3f70a2a Speed up quantization processing on H3 2026-08-03 15:21:39 -06:00
Jaret Burkett
bf739ff966 Fix issue with layer offloading with MinMax H3 2026-08-03 11:32:36 -06:00
Jaret Burkett
8502a845b1 Add support for MiniMax H3 T2V and I2V training 2026-08-03 10:17:39 -06:00