Jaret Burkett
41676bb258
Queue up videos with multiple threads when caching latents so the VAE is not waiting on videos to process
2026-08-03 15:41:36 -06:00
Jaret Burkett
d3a3f70a2a
Speed up quantization processing on H3
2026-08-03 15:21:39 -06:00
Jaret Burkett
bf739ff966
Fix issue with layer offloading with MinMax H3
2026-08-03 11:32:36 -06:00
Jaret Burkett
8502a845b1
Add support for MiniMax H3 T2V and I2V training
2026-08-03 10:17:39 -06:00
Jaret Burkett
73cab2acf5
Reworked merge in out of loras with convrot weights for better roundtrip accuracy.
2026-08-02 08:29:17 -06:00
Jaret Burkett
a6f6b6b896
Fixed experiment opt name match
2026-08-01 17:43:36 -06:00
Jaret Burkett
6b95282097
Recover from issue when a video model first fram may not have been cached properly
2026-08-01 12:00:33 -06:00
Jaret Burkett
5baa495585
DFE optimizations
2026-08-01 10:06:16 -06:00
Jaret Burkett
c68e58083f
Add code for automagic experiment
2026-08-01 10:04:46 -06:00
Jaret Burkett
497014bf5d
Set i2v to default to false when omitted from the config
2026-07-31 19:11:58 -06:00
Jaret Burkett
7b2386c096
Handle video codecs that fail in opencv
2026-07-29 21:01:57 -06:00
Jaret Burkett
9021caa723
Merge branch 'dev' of github.com:ostris/ai-toolkit into dev
2026-07-29 17:50:50 -06:00
Jaret Burkett
3f8afcac7e
Allow dataloader to encode first frame with the text embeddings if the model needs it.
2026-07-29 17:50:45 -06:00
Jaret Burkett
3d472de2f1
Reworked spawning on dataloader so windows and mac can use multiple data loader workers now
2026-07-29 17:47:04 -06:00
Jaret Burkett
c3afd95cc4
Improvements for mps convrot quants
2026-07-28 12:11:19 -06:00
Jaret Burkett
461e798708
Rework windows start and stop methods so that command windows dont appear. Stop with signal since we cannot signint.
2026-07-27 17:43:01 -06:00
Jaret Burkett
7e7053fc9a
Remove k-sampler requirement and remove it form the cold. not used anymore anyway
2026-07-27 14:58:31 -06:00
Jaret Burkett
b677cdb026
Move uintx quantization to ostris quant with bit identical matching. Now we are not bound to an older version of torch ao.
2026-07-27 12:59:42 -06:00
Jaret Burkett
fb204b7677
Fixed for DFEs with pixelspace and video models
2026-07-27 11:12:02 -06:00
Jaret Burkett
0c3a5e6970
Default to lokr full rank when not passed.
2026-07-25 09:06:49 -06:00
Jaret Burkett
efb58c8641
Switch to thumbnails and thumbnail creation on the sample grid page until clicked.
2026-07-25 08:40:33 -06:00
Jaret Burkett
8f2d001eae
Improvements to video frame loading. Added ability to cache as uint8 pixelspace for video
2026-07-24 12:36:47 -06:00
Jaret Burkett
d5612dd35c
Adjust the x0 of some DFEs
2026-07-22 10:38:40 -06:00
Jaret Burkett
1eb97b7443
Added validation loss
2026-07-19 19:33:45 -06:00
Zironic
a0224793ce
Restore device runtime scales for compiled adapters ( #963 )
...
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se >
2026-07-18 08:19:57 -06:00
Jaret Burkett
cfdc9033a6
Add min and max LR or automagic to prefent runaway edge cases.
2026-07-17 14:19:53 -06:00
Jaret Burkett
f1bc6508ad
Fix issue with qwen image edit models.
2026-07-17 09:14:04 -06:00
Jaret Burkett
6696117a94
Fix issue where the log lone for samples would double up sometimes
2026-07-17 08:11:32 -06:00
PlagueKind
3c75735ba2
remove unicode ( #955 )
2026-07-16 16:20:16 -06:00
Jaret Burkett
5fbfb502b5
Leave the generating samples bar in the log when samples finish.
2026-07-16 12:00:45 -06:00
Jaret Burkett
e805389f1e
Remove print buffer. Add new line after sampling.
2026-07-16 11:37:23 -06:00
Jaret Burkett
bbaef7852a
Do not materalize weights on ostris quantizer when getting state dict. Require dequantization of weight like other quantization methods.
2026-07-16 08:55:51 -06:00
Jaret Burkett
e1e1996c16
Rework the logging and terminal emulator on the ui to work like an actual emulator for better output.
2026-07-16 08:50:40 -06:00
rmatif
3e6bd874c4
feat: Add Anima support ( #860 )
...
* Add Anima training support
* Update Anima modular training
* Use sample guidance for Anima
* Fix Anima sampling
* Limit Anima LoRA targets
* Convert Anima LoRA exports
* Fix Anima local loading
* Update Anima default model
* Pin upstream Anima diffusers
* Adjust template defaults to be consistent with other models. Update README
---------
Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com >
2026-07-15 11:59:01 -06:00
fatalis
8bbd051667
Add sample_start_step setting to configure when sampling starts ( #949 )
...
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com >
2026-07-15 11:15:50 -06:00
Zironic
4ece17b71f
Fix adapter scalar handling under torch.compile ( #946 )
...
* Fix adapter scalar handling under torch.compile
* Fix instance where error could happen when merging in a lora to the base model
---------
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se >
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com >
2026-07-15 11:07:55 -06:00
PlagueKind
e44c34a955
fix lokr speed and convrot compile ( #945 )
2026-07-15 10:46:30 -06:00
Jaret Burkett
e28727d5cb
Made a fused GEMV kernel for convrot unpacking to increase speed further. Fix bug in test script that made train time add additional grads to bf16.
2026-07-15 10:24:52 -06:00
Jaret Burkett
cf0db39ede
Fix some errors for specific quants. Enable saving quantizations.
2026-07-14 07:25:09 -06:00
Jaret Burkett
0d53e5e1f9
Fix compile with lokr on convrot
2026-07-13 19:24:57 -06:00
Jaret Burkett
a5f857ddb0
Added patch from Fatalis to fix lokr offloading with convrot
2026-07-13 18:48:56 -06:00
Jaret Burkett
28f2c0acbe
Move z_image over to the new modeling class
2026-07-13 17:12:30 -06:00
Jaret Burkett
28b05ee4ed
Added convrotbitnet 1.58 bit quantization
2026-07-13 07:52:48 -06:00
Jaret Burkett
b6ff367633
Convrot improvements. Add argitrary bit packed byte quantizations.
2026-07-13 06:33:54 -06:00
Jaret Burkett
4625406093
WIP working on convrot offloading
2026-07-11 15:37:28 -06:00
Jaret Burkett
1d1e21177a
Add ostris linear layer to linear layer searches.
2026-07-11 14:21:16 -06:00
Jaret Burkett
095d6e7418
Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods.
2026-07-11 13:49:41 -06:00
Jaret Burkett
933ca1c517
Apply w8a8 on the forward when training with convrot for more speed. Fix issue where quantizing a model had a pin memory leak.
2026-07-11 10:53:50 -06:00
Jaret Burkett
065ac27353
Fix issue with compiling convrot on some models
2026-07-11 09:26:12 -06:00
Jaret Burkett
96a3a06111
Added initial experimental support for convrot4 and convrot8 quantization.
2026-07-10 11:01:14 -06:00
