237 Commits

Author SHA1 Message Date
Jaret Burkett
74ed5fddb0 Fix issue with ltx caching 2026-08-30 11:01:52 -06:00
Jaret Burkett
be995185f5 Fixed issue with offloading with new model loader on nvfp4 weights. 2026-08-29 12:01:40 -06:00
Jaret Burkett
683fe8afc0 Stability improvements to model offloading. Added D-OPSD bleed loss as well. 2026-08-29 11:23:47 -06:00
Jaret Burkett
7195abc32b Performance fixes and bug fixes 2026-08-28 22:21:09 -06:00
Jaret Burkett
5ddc5f8ca7 Optimize quantization path 2026-08-28 11:47:29 -06:00
Jaret Burkett
ce3df32101 Fix speed on wan conv patch 2026-08-28 10:54:26 -06:00
Jaret Burkett
92df289931 Fix quantization issues 2026-08-28 10:48:34 -06:00
Jaret Burkett
85a6880643 Move the offload and quantization to the base model 2026-08-28 08:37:56 -06:00
Jaret Burkett
702254688d Added legacy paths 2026-08-28 07:55:19 -06:00
Jaret Burkett
c3bc8b0b4e Full test of ui arch compatability 2026-08-28 06:56:05 -06:00
Jaret Burkett
520d96aac3 Phase 2 2026-08-27 18:18:31 -06:00
Jaret Burkett
45886f01b2 Phase 2 2026-08-27 16:16:35 -06:00
Jaret Burkett
9113420b61 Phase 2 2026-08-27 15:37:13 -06:00
Jaret Burkett
9ed2e0b8e7 Test model loading 2026-08-27 14:31:53 -06:00
Jaret Burkett
8db198ec0a Phase 1 2026-08-27 11:53:08 -06:00
Jaret Burkett
e8d9cf6d35 Models v2 - phase 0 2026-08-27 10:51:43 -06:00
Jaret Burkett
da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett
8a912564ce Fix video DOP methods 2026-08-26 10:05:14 -06:00
Jaret Burkett
127d6f626d Rework img/video reference in Minimax H3 to more closely match the comfy ui implementation. 2026-08-15 07:13:54 -06:00
Jaret Burkett
97bf49edad Add support for video references in MiniMax H3 ref2va 2026-08-15 06:18:09 -06:00
Jaret Burkett
5261d3fcca Add checkpointing to the Wan2.1 encoder 2026-08-14 07:31:16 -06:00
Jaret Burkett
8502a845b1 Add support for MiniMax H3 T2V and I2V training 2026-08-03 10:17:39 -06:00
Jaret Burkett
5baa495585 DFE optimizations 2026-08-01 10:06:16 -06:00
Jaret Burkett
fb204b7677 Fixed for DFEs with pixelspace and video models 2026-07-27 11:12:02 -06:00
Jaret Burkett
efb58c8641 Switch to thumbnails and thumbnail creation on the sample grid page until clicked. 2026-07-25 08:40:33 -06:00
Jaret Burkett
d5612dd35c Adjust the x0 of some DFEs 2026-07-22 10:38:40 -06:00
Zironic
a0224793ce Restore device runtime scales for compiled adapters (#963)
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
2026-07-18 08:19:57 -06:00
Jaret Burkett
6696117a94 Fix issue where the log lone for samples would double up sometimes 2026-07-17 08:11:32 -06:00
PlagueKind
3c75735ba2 remove unicode (#955) 2026-07-16 16:20:16 -06:00
Jaret Burkett
5fbfb502b5 Leave the generating samples bar in the log when samples finish. 2026-07-16 12:00:45 -06:00
Zironic
4ece17b71f Fix adapter scalar handling under torch.compile (#946)
* Fix adapter scalar handling under torch.compile

* Fix instance where error could happen when merging in a lora to the base model

---------

Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
2026-07-15 11:07:55 -06:00
PlagueKind
e44c34a955 fix lokr speed and convrot compile (#945) 2026-07-15 10:46:30 -06:00
Jaret Burkett
0d53e5e1f9 Fix compile with lokr on convrot 2026-07-13 19:24:57 -06:00
Jaret Burkett
a5f857ddb0 Added patch from Fatalis to fix lokr offloading with convrot 2026-07-13 18:48:56 -06:00
Jaret Burkett
28f2c0acbe Move z_image over to the new modeling class 2026-07-13 17:12:30 -06:00
Jaret Burkett
4625406093 WIP working on convrot offloading 2026-07-11 15:37:28 -06:00
Jaret Burkett
1d1e21177a Add ostris linear layer to linear layer searches. 2026-07-11 14:21:16 -06:00
Jaret Burkett
71c75357eb Add cached conditioning recovery to wan 22 5b model 2026-07-10 10:22:24 -06:00
Jaret Burkett
886c2aec57 Allow for vae tiling onle without low vram on wan models with a model kwarg 2026-07-10 09:42:52 -06:00
Jaret Burkett
883d60eb71 Do vae tiling when decoding wan models with low vram active. 2026-07-10 08:02:32 -06:00
Jaret Burkett
5f04ae7ad5 Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning. 2026-06-25 13:19:38 -06:00
Jaret Burkett
d14f6e567a Allow individual models to scale the loss after it is calculated. 2026-06-25 10:13:58 -06:00
Jaret Burkett
af594061ab Add ability to do hidden states with tipsv2 2026-06-22 11:00:04 -06:00
Jaret Burkett
820d534d6e Add features for models that may need a non masked loss such as inpainiting. 2026-06-22 10:59:17 -06:00
Jaret Burkett
6a8d9333b6 Improved the prompt handeling of ideogram4 model. Now used advanced prompts class to store them smaller and allow longer prompts 2026-06-04 13:00:23 -06:00
Jaret Burkett
d9f26c2f87 Add gradient checkpointing to tipsv2 heads 2026-06-01 05:00:15 -06:00
Jaret Burkett
e5439509b5 Added pure lpips dfe 2026-05-31 11:52:03 -06:00
Jaret Burkett
aecd554128 Add sapiens2 matting as a mask generator. Begin transition to model paths and model folders. 2026-05-20 08:56:16 -06:00
Jaret Burkett
4bfe944792 Scale dfe 7 with velocity_equiv_weight 2026-05-13 09:06:59 -06:00
Jaret Burkett
f38de2a2fe Add tipsv2 locally and fix gradient checkpointing for it 2026-05-10 14:47:44 -06:00