Jaret Burkett
ab5fef8970
Fix caption dropout so it now works identically when caching text embeddings.
2026-08-10 18:53:33 -06:00
Jaret Burkett
257da9b586
Rework DOP so it works with caching text embeddings
2026-08-09 22:13:49 -06:00
Jaret Burkett
72623ed3d6
When doing auto frame count. Ensure the time is not squeezed or expanded to fit tempooral spacing. trime the few extra frames. Also fixed frame counts of buckets.
2026-08-09 12:31:02 -06:00
Jaret Burkett
682b27c6ee
Reworked freeing memory manager for removing text encoder completly when not needed.
2026-08-09 07:08:24 -06:00
Jaret Burkett
8c1a4082fd
Allow images to work with auto frame count, and include images in video datasets if they exist.
2026-08-08 20:26:28 -06:00
Fitzy
d184c6c622
Fix offload buffer stream lifetime
2026-08-08 19:59:23 -04:00
Jaret Burkett
f4e9130547
Fix race condition that can corrupt grads under certain conditions.
2026-08-07 14:52:47 -06:00
Jaret Burkett
1e1418b22c
Apply sigma to contrastive guidance to balance loss better. Prevent noise grads on images/non audio datasets. Prep for training adapters on MiniMax H3
2026-08-05 13:27:12 -06:00
Jaret Burkett
3afa270ab5
Fix audio losses for DOP and other preservation losses
2026-08-04 22:08:48 -06:00
Jaret Burkett
0f9094db95
Fix audio loss when doing do_guidance_loss
2026-08-04 21:43:31 -06:00
Jaret Burkett
d870e9b68a
Fix backwards compatability for older versions of triton
2026-08-04 21:07:57 -06:00
Jaret Burkett
00a93e3830
Add dataset flag to cache the raw tensors
2026-08-04 15:32:48 -06:00
Jaret Burkett
8a0bcf1ffe
Fix issue loading H3 test encoder on older GPUS
2026-08-04 15:30:29 -06:00
Jaret Burkett
a9a04547e9
Dont move encoders on and off device when caching until the first instance of needing to process a cache item.
2026-08-03 15:54:30 -06:00
Jaret Burkett
41676bb258
Queue up videos with multiple threads when caching latents so the VAE is not waiting on videos to process
2026-08-03 15:41:36 -06:00
Jaret Burkett
d3a3f70a2a
Speed up quantization processing on H3
2026-08-03 15:21:39 -06:00
Jaret Burkett
bf739ff966
Fix issue with layer offloading with MinMax H3
2026-08-03 11:32:36 -06:00
Jaret Burkett
8502a845b1
Add support for MiniMax H3 T2V and I2V training
2026-08-03 10:17:39 -06:00
Jaret Burkett
73cab2acf5
Reworked merge in out of loras with convrot weights for better roundtrip accuracy.
2026-08-02 08:29:17 -06:00
Jaret Burkett
a6f6b6b896
Fixed experiment opt name match
2026-08-01 17:43:36 -06:00
Jaret Burkett
6b95282097
Recover from issue when a video model first fram may not have been cached properly
2026-08-01 12:00:33 -06:00
Jaret Burkett
5baa495585
DFE optimizations
2026-08-01 10:06:16 -06:00
Jaret Burkett
c68e58083f
Add code for automagic experiment
2026-08-01 10:04:46 -06:00
Jaret Burkett
497014bf5d
Set i2v to default to false when omitted from the config
2026-07-31 19:11:58 -06:00
Jaret Burkett
7b2386c096
Handle video codecs that fail in opencv
2026-07-29 21:01:57 -06:00
Jaret Burkett
9021caa723
Merge branch 'dev' of github.com:ostris/ai-toolkit into dev
2026-07-29 17:50:50 -06:00
Jaret Burkett
3f8afcac7e
Allow dataloader to encode first frame with the text embeddings if the model needs it.
2026-07-29 17:50:45 -06:00
Jaret Burkett
3d472de2f1
Reworked spawning on dataloader so windows and mac can use multiple data loader workers now
2026-07-29 17:47:04 -06:00
Jaret Burkett
c3afd95cc4
Improvements for mps convrot quants
2026-07-28 12:11:19 -06:00
Jaret Burkett
461e798708
Rework windows start and stop methods so that command windows dont appear. Stop with signal since we cannot signint.
2026-07-27 17:43:01 -06:00
Jaret Burkett
7e7053fc9a
Remove k-sampler requirement and remove it form the cold. not used anymore anyway
2026-07-27 14:58:31 -06:00
Jaret Burkett
b677cdb026
Move uintx quantization to ostris quant with bit identical matching. Now we are not bound to an older version of torch ao.
2026-07-27 12:59:42 -06:00
Jaret Burkett
fb204b7677
Fixed for DFEs with pixelspace and video models
2026-07-27 11:12:02 -06:00
Jaret Burkett
0c3a5e6970
Default to lokr full rank when not passed.
2026-07-25 09:06:49 -06:00
Jaret Burkett
efb58c8641
Switch to thumbnails and thumbnail creation on the sample grid page until clicked.
2026-07-25 08:40:33 -06:00
Jaret Burkett
8f2d001eae
Improvements to video frame loading. Added ability to cache as uint8 pixelspace for video
2026-07-24 12:36:47 -06:00
Jaret Burkett
d5612dd35c
Adjust the x0 of some DFEs
2026-07-22 10:38:40 -06:00
Jaret Burkett
1eb97b7443
Added validation loss
2026-07-19 19:33:45 -06:00
Zironic
a0224793ce
Restore device runtime scales for compiled adapters ( #963 )
...
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se >
2026-07-18 08:19:57 -06:00
Jaret Burkett
cfdc9033a6
Add min and max LR or automagic to prefent runaway edge cases.
2026-07-17 14:19:53 -06:00
Jaret Burkett
f1bc6508ad
Fix issue with qwen image edit models.
2026-07-17 09:14:04 -06:00
Jaret Burkett
6696117a94
Fix issue where the log lone for samples would double up sometimes
2026-07-17 08:11:32 -06:00
PlagueKind
3c75735ba2
remove unicode ( #955 )
2026-07-16 16:20:16 -06:00
Jaret Burkett
5fbfb502b5
Leave the generating samples bar in the log when samples finish.
2026-07-16 12:00:45 -06:00
Jaret Burkett
e805389f1e
Remove print buffer. Add new line after sampling.
2026-07-16 11:37:23 -06:00
Jaret Burkett
bbaef7852a
Do not materalize weights on ostris quantizer when getting state dict. Require dequantization of weight like other quantization methods.
2026-07-16 08:55:51 -06:00
Jaret Burkett
e1e1996c16
Rework the logging and terminal emulator on the ui to work like an actual emulator for better output.
2026-07-16 08:50:40 -06:00
rmatif
3e6bd874c4
feat: Add Anima support ( #860 )
...
* Add Anima training support
* Update Anima modular training
* Use sample guidance for Anima
* Fix Anima sampling
* Limit Anima LoRA targets
* Convert Anima LoRA exports
* Fix Anima local loading
* Update Anima default model
* Pin upstream Anima diffusers
* Adjust template defaults to be consistent with other models. Update README
---------
Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com >
2026-07-15 11:59:01 -06:00
fatalis
8bbd051667
Add sample_start_step setting to configure when sampling starts ( #949 )
...
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com >
2026-07-15 11:15:50 -06:00
Zironic
4ece17b71f
Fix adapter scalar handling under torch.compile ( #946 )
...
* Fix adapter scalar handling under torch.compile
* Fix instance where error could happen when merging in a lora to the base model
---------
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se >
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com >
2026-07-15 11:07:55 -06:00
