Commit Graph

1384 Commits

Author SHA1 Message Date
Jaret Burkett
a8d67ecd90 Version Bump 2026-08-04 16:28:04 -06:00
Jaret Burkett
9fc1f208df Remove adaln_proj from the network modules for minimax_h3 2026-08-04 16:19:46 -06:00
Jaret Burkett
183433ae8e Make MiniMax H3 default to using contrastive guidance loss to prevent distillation breakdown 2026-08-04 16:13:45 -06:00
Jaret Burkett
00a93e3830 Add dataset flag to cache the raw tensors 2026-08-04 15:32:48 -06:00
Jaret Burkett
8a0bcf1ffe Fix issue loading H3 test encoder on older GPUS 2026-08-04 15:30:29 -06:00
Jaret Burkett
dc29ae1187 Version Bump 2026-08-04 09:27:46 -06:00
Jaret Burkett
d20a17c10e Limit max tokens to 512. Allow override with model kwargs. 2026-08-04 07:55:21 -06:00
Jaret Burkett
602306da77 Add gradient checkpointing to vae 2026-08-04 07:54:51 -06:00
Jaret Burkett
18f5810d6c Adjust default alpha for h3 2026-08-03 20:15:28 -06:00
Jaret Burkett
a9a04547e9 Dont move encoders on and off device when caching until the first instance of needing to process a cache item. 2026-08-03 15:54:30 -06:00
Jaret Burkett
41676bb258 Queue up videos with multiple threads when caching latents so the VAE is not waiting on videos to process 2026-08-03 15:41:36 -06:00
Jaret Burkett
546eb7daff Look for existing models in folders recursivly 2026-08-03 15:39:55 -06:00
Jaret Burkett
d3a3f70a2a Speed up quantization processing on H3 2026-08-03 15:21:39 -06:00
Jaret Burkett
88ac27fc8f Handle images with MiniMax H3. 2026-08-03 11:58:44 -06:00
Jaret Burkett
bf739ff966 Fix issue with layer offloading with MinMax H3 2026-08-03 11:32:36 -06:00
Jaret Burkett
9d614a51fb Hard fail if a step in the docker build fails. 2026-08-03 10:38:31 -06:00
Jaret Burkett
8502a845b1 Add support for MiniMax H3 T2V and I2V training 2026-08-03 10:17:39 -06:00
Jaret Burkett
73cab2acf5 Reworked merge in out of loras with convrot weights for better roundtrip accuracy. 2026-08-02 08:29:17 -06:00
Jaret Burkett
a6f6b6b896 Fixed experiment opt name match 2026-08-01 17:43:36 -06:00
Jaret Burkett
6b95282097 Recover from issue when a video model first fram may not have been cached properly 2026-08-01 12:00:33 -06:00
Jaret Burkett
5baa495585 DFE optimizations 2026-08-01 10:06:16 -06:00
Jaret Burkett
fc78b07332 Attach the ema to the base model so it can be used on specific models 2026-08-01 10:05:42 -06:00
Jaret Burkett
c68e58083f Add code for automagic experiment 2026-08-01 10:04:46 -06:00
Jaret Burkett
497014bf5d Set i2v to default to false when omitted from the config 2026-07-31 19:11:58 -06:00
Jaret Burkett
038f24e8c3 Revert torchao back to older version 2026-07-31 16:34:06 -06:00
Jaret Burkett
6e7bc81241 Allow random noise shift with video latents. 2026-07-31 05:58:08 -06:00
Jaret Burkett
ddc69745fe Update docker build image with newer dependencies 2026-07-30 14:20:31 -06:00
Jaret Burkett (Ostris)
2cab330392 Merge pull request #986 from ostris/dev
Add AI Toolkit Manager script that auto installs/runs/and updates AI Toolkit.
2026-07-30 11:55:13 -06:00
Jaret Burkett
c8636478f9 Version Bump 2026-07-30 11:48:01 -06:00
Jaret Burkett
7b2386c096 Handle video codecs that fail in opencv 2026-07-29 21:01:57 -06:00
Jaret Burkett
9021caa723 Merge branch 'dev' of github.com:ostris/ai-toolkit into dev 2026-07-29 17:50:50 -06:00
Jaret Burkett
3f8afcac7e Allow dataloader to encode first frame with the text embeddings if the model needs it. 2026-07-29 17:50:45 -06:00
Jaret Burkett
23f1ebfb76 Update to high speed xet env var 2026-07-29 17:47:53 -06:00
Jaret Burkett
3d472de2f1 Reworked spawning on dataloader so windows and mac can use multiple data loader workers now 2026-07-29 17:47:04 -06:00
Jaret Burkett
65443cfffa Add information about the new manager to the README 2026-07-29 10:29:36 -06:00
Jaret Burkett
3bd2119c04 Add flash-linear-attention package for hardware that supports it. 2026-07-29 09:14:37 -06:00
Jaret Burkett
1e22732db7 Merge branch 'dev' of https://github.com/ostris/ai-toolkit into dev 2026-07-28 12:27:55 -06:00
Jaret Burkett
aa762103b3 Add build support for Nvidia Spark 2026-07-28 12:27:51 -06:00
Jaret Burkett
c3afd95cc4 Improvements for mps convrot quants 2026-07-28 12:11:19 -06:00
Jaret Burkett
038270eb2f Fix issue with macstats on mac 2026-07-28 08:27:31 -06:00
Jaret Burkett
83879ac7c2 Fix issue with user agent downloading ffmpeg 2026-07-28 08:15:28 -06:00
Jaret Burkett
6d6c5a3d91 Prevent overwriting package-lock.json when installing deps 2026-07-27 18:47:28 -06:00
Jaret Burkett
461e798708 Rework windows start and stop methods so that command windows dont appear. Stop with signal since we cannot signint. 2026-07-27 17:43:01 -06:00
Jaret Burkett
6b0449c326 Fixed install issues with windows builds 2026-07-27 16:06:48 -06:00
Jaret Burkett
1e58c9a0f0 Built a universal manager and installer for all operating systems and environments. Bumped a lot of versions of things. Still needs deep testing. 2026-07-27 15:10:29 -06:00
Jaret Burkett
7e7053fc9a Remove k-sampler requirement and remove it form the cold. not used anymore anyway 2026-07-27 14:58:31 -06:00
Jaret Burkett
b677cdb026 Move uintx quantization to ostris quant with bit identical matching. Now we are not bound to an older version of torch ao. 2026-07-27 12:59:42 -06:00
Jaret Burkett
fb204b7677 Fixed for DFEs with pixelspace and video models 2026-07-27 11:12:02 -06:00
Jaret Burkett
0e17841767 Version bump 2026-07-25 11:34:33 -06:00
Jaret Burkett
92bdb6e473 Add support for Mage-Flow and Mage-Flow Edit 2026-07-25 11:34:20 -06:00