Commit Graph

1425 Commits

Author SHA1 Message Date
Jaret Burkett
175cc1e151 Add Qwen 3 Omni for captioning videos with sound. 2026-08-12 19:57:01 -06:00
Jaret Burkett
4b00b61257 When doing an audio loss, show the img and audio loss in the loss log 2026-08-12 18:58:54 -06:00
Jaret Burkett
e16e04f123 On the ui, keep the last caption job bar visible at the bottom of a dataset so it can be viewed and edited 2026-08-12 17:32:48 -06:00
Jaret Burkett
18645d93b7 Fix trailing slashes in path for settings 2026-08-12 17:04:22 -06:00
Jaret Burkett
a1ddeeef13 Fixed issue with offloading text encoder on ltx 2.5 2026-08-12 10:46:58 -06:00
Jaret Burkett
0fd3e61c4c Expand loras to match if they are not the same size in lora merger 2026-08-12 10:04:44 -06:00
Jaret Burkett
0bacc88e47 Version Bump 2026-08-12 07:55:21 -06:00
Jaret Burkett
7eb65b837a Switch MiniMax H3 to default to contrastive guidance loss. Add a custom model select toggle to automatically fill out settings for the model. 2026-08-12 07:54:57 -06:00
Jaret Burkett
cbf910ac02 Add support for LTX 2.5 2026-08-12 05:50:30 -06:00
Jaret Burkett
924c426675 Resolve the new ltx 2.5 path subfolder for ltx 2.5. Sill checking compatability. 2026-08-11 13:30:17 -06:00
Jaret Burkett
62017a915a Version bump 2026-08-11 08:30:09 -06:00
Jaret Burkett
21dc65972d Only add a blank control if the model has to have it, for unconditionals. Previously it always encoded a blank control on unconditional if the model could take one. Affects DOP and blank prompt preservations. 2026-08-11 08:25:23 -06:00
Jaret Burkett
f421542df4 When dropping out, caching, and doing DOP, make sure we select a cahced trigger word when dropped out so DOP matches the drop out embeddings. 2026-08-11 06:59:20 -06:00
Jaret Burkett
8d4beedd04 Move guidance loss target selection when given a range before preservation so it is avaliable during preservation. 2026-08-11 06:57:33 -06:00
Jaret Burkett
ab5fef8970 Fix caption dropout so it now works identically when caching text embeddings. 2026-08-10 18:53:33 -06:00
Jaret Burkett
356ce7e84e Version bump 2026-08-10 09:21:27 -06:00
Jaret Burkett
257da9b586 Rework DOP so it works with caching text embeddings 2026-08-09 22:13:49 -06:00
Jaret Burkett
5ff8a0435a Make v1 the default training adapter 2026-08-09 14:56:39 -06:00
Jaret Burkett
61da9c95d3 Version bump 2026-08-09 12:39:30 -06:00
Jaret Burkett
72623ed3d6 When doing auto frame count. Ensure the time is not squeezed or expanded to fit tempooral spacing. trime the few extra frames. Also fixed frame counts of buckets. 2026-08-09 12:31:02 -06:00
Jaret Burkett
682b27c6ee Reworked freeing memory manager for removing text encoder completly when not needed. 2026-08-09 07:08:24 -06:00
Jaret Burkett
3a28c4b1b7 Keep alive cron server to prevent failed connections 2026-08-08 20:27:01 -06:00
Jaret Burkett
8c1a4082fd Allow images to work with auto frame count, and include images in video datasets if they exist. 2026-08-08 20:26:28 -06:00
Jaret Burkett
6d8afa5684 Version bump 2026-08-08 18:58:11 -06:00
Jaret Burkett (Ostris)
c596d4ab27 Merge pull request #1002 from whatsthisaithing/codex/fix-convrot-offload-stream-lifetime
Fix offload buffer stream lifetime
2026-08-08 18:55:18 -06:00
Fitzy
d184c6c622 Fix offload buffer stream lifetime 2026-08-08 19:59:23 -04:00
Jaret Burkett
f4e9130547 Fix race condition that can corrupt grads under certain conditions. 2026-08-07 14:52:47 -06:00
Jaret Burkett
817f3dcbcb Fix finite check on inverted masked prior 2026-08-07 09:49:12 -06:00
Jaret Burkett
685ce37a8d Adjust sample timestep sigmas to be model evals for h3 for 1 extra step 2026-08-06 19:54:04 -06:00
Jaret Burkett
9171d5ec1d Update training adapter path 2026-08-06 11:21:28 -06:00
Jaret Burkett
71625d1207 Add the alpha version of the MiniMax H3 trianing adapter and set it as the new default training method. 2026-08-06 11:11:31 -06:00
Jaret Burkett
b904b99705 varsion bump 2026-08-06 09:25:35 -06:00
Jaret Burkett
b811636ae4 Check for finite vs isnan on loss before backpropigating. to catch infinity overflows 2026-08-06 09:18:56 -06:00
Jaret Burkett
edacd406b3 Handle minimax loading of non pruned model 2026-08-06 09:18:00 -06:00
Jaret Burkett
7309db4d74 Fix layer offloaded adaln projection layer move 2026-08-06 08:10:20 -06:00
Jaret Burkett
139a38f5bd Upcast adaln pruned layers to fp32 on h3 to prevent overflow. 2026-08-06 07:51:15 -06:00
Jaret Burkett
1e1418b22c Apply sigma to contrastive guidance to balance loss better. Prevent noise grads on images/non audio datasets. Prep for training adapters on MiniMax H3 2026-08-05 13:27:12 -06:00
Jaret Burkett
9065951da3 Version bump 2026-08-04 22:14:54 -06:00
Jaret Burkett
3afa270ab5 Fix audio losses for DOP and other preservation losses 2026-08-04 22:08:48 -06:00
Jaret Burkett
0f9094db95 Fix audio loss when doing do_guidance_loss 2026-08-04 21:43:31 -06:00
Jaret Burkett
d870e9b68a Fix backwards compatability for older versions of triton 2026-08-04 21:07:57 -06:00
Jaret Burkett
a8d67ecd90 Version Bump 2026-08-04 16:28:04 -06:00
Jaret Burkett
9fc1f208df Remove adaln_proj from the network modules for minimax_h3 2026-08-04 16:19:46 -06:00
Jaret Burkett
183433ae8e Make MiniMax H3 default to using contrastive guidance loss to prevent distillation breakdown 2026-08-04 16:13:45 -06:00
Jaret Burkett
00a93e3830 Add dataset flag to cache the raw tensors 2026-08-04 15:32:48 -06:00
Jaret Burkett
8a0bcf1ffe Fix issue loading H3 test encoder on older GPUS 2026-08-04 15:30:29 -06:00
Jaret Burkett
dc29ae1187 Version Bump 2026-08-04 09:27:46 -06:00
Jaret Burkett
d20a17c10e Limit max tokens to 512. Allow override with model kwargs. 2026-08-04 07:55:21 -06:00
Jaret Burkett
602306da77 Add gradient checkpointing to vae 2026-08-04 07:54:51 -06:00
Jaret Burkett
18f5810d6c Adjust default alpha for h3 2026-08-03 20:15:28 -06:00