Jaret Burkett
171535833a
Add Mac OS support for Apple Silicon ( #770 )
...
* Made an install script and auto updates env for mac
* GPU sensors and initial training working for MAC. Still WIP.
* Switch dataloader to single threaded until I can work around some mac pickeling issues.
* Get quantization working on mac
* Fix mac exclusive imports so they don't break other builds.
* Add mac instructions to the UI
2026-03-30 09:37:47 -06:00
Jaret Burkett
6a1fc54779
Add t0 loss target
2026-03-28 13:35:21 -06:00
Jaret Burkett
f85bf065bf
Use pooler embeddings for DFE v6 with dino v3
2026-03-27 07:02:07 -06:00
Rodrigo Reis
54f4732c9b
Fix the bug in temporal_compression data loader ( #754 )
2026-03-25 08:16:44 -06:00
Jaret Burkett
7f3309b291
Add support for audo frame count so datasets can have varrying length videos. Varous ltx 2.3 VAE optimizations such as removing tiling articacts, and doing frame split encoding to reduce vram on encoding/decoding.
2026-03-24 12:20:09 -06:00
Jaret Burkett
5642b656b9
Fix audio issues with ltx2 models. Silent codec fails now raised. Auto convert surround sound audio to stereo. Invalidate old caches just to be safe so they recache now.
2026-03-23 20:08:33 +00:00
Jaret Burkett
0f075fc45e
Adjust signal amplification target. Allow signal amplification strength in config.
2026-03-22 08:30:13 -06:00
Jaret Burkett
dcd98dc0d5
Add signal amplification
2026-03-21 07:44:18 -06:00
Jaret Burkett
35b1cde3cb
Fixed issue on z-image that prevented training at a larger batch size
2026-03-10 15:43:25 -06:00
Jaret Burkett
4909b809c7
Fixed issue with audio loss multiplier.
2026-03-10 15:16:09 -06:00
Jaret Burkett
06ef3d343a
add ability to use batch noise correction during training
2026-03-10 09:05:57 -06:00
Jaret Burkett
b04c64e0f8
Add a dino version of DFE
2026-03-04 08:20:37 -07:00
Jaret Burkett
40f995f616
Add method to do continuious lora merging in for low vram full finetuning.
2026-02-26 09:00:41 -07:00
Jaret Burkett
1c74ca5d22
Add audio_loss_multiplier to scale audio loss to larger values if desired.
2026-02-19 11:57:44 -07:00
Jaret Burkett
3632656cda
make DFE work with more VAEs
2026-02-18 09:46:37 -07:00
Jaret Burkett
a055947d56
Add signal_correction_noise_scale to config to scale the signal correction strength
2026-02-07 12:04:21 -07:00
Jaret Burkett
454722cc97
Add signal correction noise
2026-02-07 09:49:55 -07:00
Jaret Burkett
115f0a3670
Fixed error with wan models when caching text embeddings
2026-02-06 14:26:53 -07:00
Jaret Burkett
5c37db04f9
Added ability to activate experimental blank stabilization during training to zero out latents with blank prompts.
2026-02-04 13:00:03 -07:00
Jaret Burkett
1ce2428722
Shrink text embeds to max token length for LTX-2. Drastically reduces cached text embedding sizes
2026-01-28 12:54:49 -07:00
Jaret Burkett
73dedbf662
Do caching of latents, first frame and audio when caching latents for LTX2
2026-01-14 11:05:23 -07:00
Jaret Burkett
5b5aadadb8
Add LTX-2 Support ( #644 )
...
* WIP, adding support for LTX2
* Training on images working
* Fix loading comfy models
* Handle converting and deconverting lora so it matches original format
* Reworked ui to habdle ltx and propert dataset default overwriting.
* Update the way lokr saves to it is more compatable with comfy
* Audio loading and synchronization/resampling is working
* Add audio to training. Does it work? Maybe, still testing.
* Fixed fps default issue for sound
* Have ui set fps for accurate audio mapping on ltx
* Added audio procession options to the ui for ltx
* Clean up requirements
2026-01-13 04:55:30 -07:00
Jaret Burkett
a767b82b60
Fixed issue with new logger when ooming
2025-12-25 16:57:34 +00:00
Jaret Burkett
87edca1b2b
Added initial support to initiate lora training from an existing lora
2025-12-22 12:49:15 -07:00
Jaret Burkett
8864ba915e
Remove easy-dwpose from the default requierments
2025-12-20 07:16:20 -07:00
Jaret Burkett
ba00eea7d9
Add loss graph to the ui
2025-12-18 10:08:59 -07:00
Jaret Burkett
e6c5aead3b
Fix issue that prevented ramtorch layer offloading with z_image
2025-12-02 16:14:34 -07:00
Jaret Burkett
d42f5af2fc
Fixed issue with DOP when using Z-Image
2025-11-28 09:36:21 -07:00
Jaret Burkett
08a39754a4
Fixed issue that prevented caching text embeddings on z-image
2025-11-28 09:19:39 -07:00
Jaret Burkett
4e62c38df5
Add support for training Z-Image Turbo with a de-distill training adapter
2025-11-28 08:08:53 -07:00
Jaret Burkett
50e5d99545
Fix issue where text encoder was not fully unloaded in some instances
2025-11-19 09:01:00 -07:00
Jaret Burkett
323b4aaf5a
Do not copy pin memory if it fails, just move
2025-11-17 18:04:00 +00:00
Jaret Burkett
2e7b2d9926
Added Differential Guidance training target
2025-11-10 09:38:25 -07:00
Jaret Burkett
6f308fc46e
When soing guidance loss, make CFG zero an optional target instead of a forced one.
2025-11-04 09:16:15 -07:00
Jaret Burkett
8c12977891
Fixed adafactor eps
2025-10-26 05:47:25 -06:00
Jaret Burkett
ee206cfa18
Added blank prompt preservation
2025-10-22 14:55:13 -06:00
Jaret Burkett
ff14cd6343
Fix check for making sure vae is on the right device.
2025-10-21 14:49:20 -06:00
Jaret Burkett
5123090f6c
Adjust dataloader tester to handle videos to test them
2025-10-21 14:47:23 -06:00
Jaret Burkett
0d8a33dc16
Offload ARA with the layer if doing layer offloading. Add support to offload the LoRA. Still needs optimizer support
2025-10-21 06:03:27 -06:00
Jaret Burkett
76ce757e0c
Added initial support for layer offloading wit Wan 2.2 14B models.
2025-10-20 14:54:30 -06:00
Jaret Burkett
1f81bc4060
Fix issue where text encoder could be the wrong quantization and fail when using memory manager
2025-10-15 11:01:30 -06:00
Jaret Burkett
7abf5e20be
Add conv3d to memory management excluded modules
2025-10-15 10:12:06 -06:00
Jaret Burkett
1bc6dee127
Change auto_memory to be layer_offloading and allow you to set the amount to unload
2025-10-10 13:12:32 -06:00
Jaret Burkett
55b8b0e23e
Fix issue where ARA was not working when using memory manager
2025-10-07 13:39:44 -06:00
Jaret Burkett
c9f982af83
Add support for using quantized models with ramtorch
2025-10-06 13:46:57 -06:00
Jaret Burkett
dc1cc3e78a
Fixed issue where multi control samples didnt work when not caching
2025-10-05 14:38:53 -06:00
Jaret Burkett
4e5707854f
Initial support for RamTorch. Still a WIP
2025-10-05 13:03:26 -06:00
Jaret Burkett
3086a58e5b
git status
2025-10-01 14:12:17 -06:00
Jaret Burkett
3b1f7b0948
Allow user to set the attention backend. Add method to recomver from the occasional OOM if it is a rare event. Still exit if it ooms 3 times in a row.
2025-09-27 08:56:15 -06:00
Jaret Burkett
be990630b9
Remove dropout from cached text embeddings even if used specifies it so blank prompts are not cached.
2025-09-26 11:50:53 -06:00
