Jaret Burkett
4e50535478
Allow models to provide an additional loss
2026-06-28 09:49:36 -06:00
Jaret Burkett
1e12b6b73f
Remove duplicate save when triggering save next step
2026-06-28 07:18:16 -06:00
Jaret Burkett
d14f6e567a
Allow individual models to scale the loss after it is calculated.
2026-06-25 10:13:58 -06:00
Jaret Burkett
820d534d6e
Add features for models that may need a non masked loss such as inpainiting.
2026-06-22 10:59:17 -06:00
Jaret Burkett
cac3815b2c
Make DOP run in a single backward pass, should be faster and more stable. Show dop loss on ui
2026-06-08 13:55:47 -06:00
Jaret Burkett
68e9b38220
Add ability to trigger a save from the ui which whill make the trainer save on the next step
2026-05-26 08:38:49 -06:00
Jaret Burkett
12304e170f
Added some experimental loss targets
2026-05-24 14:13:23 -06:00
Jaret Burkett
ec58dcde92
Add better gradient checkpointing to dfes
2026-05-18 09:25:23 -06:00
Jaret Burkett (Ostris)
fc4d6ebf39
Add support for fine-tuning Hidream O1 ( #831 )
...
* Initial support for hidream. Lora keys likely need work
* Fix saving for hidream-o1
* Remove dependence on flash attention for hidream o1
* Fix gradient checkpointing for hidream o1
* A lot of fixes for hidream. Handle loading and saving as comfy model.
* Omit layers not used in comfy. Fix issue with lora loading keys in comfy
* Version bumpo
2026-05-12 11:15:16 -06:00
Jaret Burkett
e9ab387dfd
Fixed issue with qwen image edit models when using multiple control images when not caching text embeddings.
2026-04-30 11:59:12 +00:00
Jaret Burkett
1fc4ad3979
Add sapiens2 as a diffusion feature extractor
2026-04-27 15:59:03 -06:00
Jaret Burkett
998a02f30e
Yet another pseudo_huber fix. Still drinking coffee.
2026-04-19 10:05:40 -06:00
Jaret Burkett
fc85410c9a
Fix issue with precision on pseudo_huber loss
2026-04-19 10:02:27 -06:00
Jaret Burkett
20a99258b8
Fix issue is is else on pseudo_huber loss
2026-04-19 09:59:18 -06:00
Jaret Burkett
f4445cd78c
Added psuedo_huber loss
2026-04-19 09:51:46 -06:00
Jaret Burkett
beb40ae29b
Add DFE8 with partial step
2026-04-17 17:40:16 -06:00
Jaret Burkett
233e292256
Added some experimental low step things for zeta
2026-04-13 09:37:34 -06:00
Jaret Burkett
bf56217c37
Fixed issue where job would fail if DB is locked.
2026-03-31 09:10:33 -06:00
Jaret Burkett
171535833a
Add Mac OS support for Apple Silicon ( #770 )
...
* Made an install script and auto updates env for mac
* GPU sensors and initial training working for MAC. Still WIP.
* Switch dataloader to single threaded until I can work around some mac pickeling issues.
* Get quantization working on mac
* Fix mac exclusive imports so they don't break other builds.
* Add mac instructions to the UI
2026-03-30 09:37:47 -06:00
Jaret Burkett
6a1fc54779
Add t0 loss target
2026-03-28 13:35:21 -06:00
Jaret Burkett
7e1fdc3844
Remove the 0.1 floor for amplification
2026-03-22 09:01:58 -06:00
Jaret Burkett
0f075fc45e
Adjust signal amplification target. Allow signal amplification strength in config.
2026-03-22 08:30:13 -06:00
Jaret Burkett
dcd98dc0d5
Add signal amplification
2026-03-21 07:44:18 -06:00
Jaret Burkett
b04c64e0f8
Add a dino version of DFE
2026-03-04 08:20:37 -07:00
Jaret Burkett
1c74ca5d22
Add audio_loss_multiplier to scale audio loss to larger values if desired.
2026-02-19 11:57:44 -07:00
Jaret Burkett
5b5aadadb8
Add LTX-2 Support ( #644 )
...
* WIP, adding support for LTX2
* Training on images working
* Fix loading comfy models
* Handle converting and deconverting lora so it matches original format
* Reworked ui to habdle ltx and propert dataset default overwriting.
* Update the way lokr saves to it is more compatable with comfy
* Audio loading and synchronization/resampling is working
* Add audio to training. Does it work? Maybe, still testing.
* Fixed fps default issue for sound
* Have ui set fps for accurate audio mapping on ltx
* Added audio procession options to the ui for ltx
* Clean up requirements
2026-01-13 04:55:30 -07:00
Jaret Burkett
2e7b2d9926
Added Differential Guidance training target
2025-11-10 09:38:25 -07:00
Jaret Burkett
6f308fc46e
When soing guidance loss, make CFG zero an optional target instead of a forced one.
2025-11-04 09:16:15 -07:00
Jaret Burkett
42e5e3cd1c
Adjust DFE to handle 5 dimension latent spaces
2025-10-27 07:48:44 -06:00
Jaret Burkett
80418209b8
Fixe a variable that could nt be declared when doing blank prompt preservation
2025-10-23 16:19:56 -06:00
Jaret Burkett
ee206cfa18
Added blank prompt preservation
2025-10-22 14:55:13 -06:00
Jaret Burkett
91b87e06a1
Reordered logs
2025-10-15 09:15:06 -06:00
Jaret Burkett
7e34a03113
Added queing system to the UI
2025-10-14 12:00:42 -06:00
Jaret Burkett
2ba4000704
Allow masked losses with video models
2025-09-30 14:57:07 -06:00
Jaret Burkett
454be0958a
Initial support for qwen image edit plus
2025-09-24 11:39:10 -06:00
Jaret Burkett
f74475161e
Add stepped loss type
2025-09-22 15:50:12 -06:00
Jaret Burkett
28728a1e92
Added experimental dfe 5
2025-09-21 10:48:52 -06:00
Jaret Burkett
3cdf50cbfc
Merge pull request #426 from squewel/prior_reg
...
Dataset-level prior regularization
2025-09-18 03:03:18 -06:00
max
e4ae97e790
add dataset-level distillation-style regularization
2025-09-18 01:11:19 +03:00
Jaret Burkett
218f673e3d
Added support for new concept slider training script to CLI and UI
2025-09-16 10:22:34 -06:00
Jaret Burkett
645046701b
Comment out fast stop watcher. Could potentiallty be causing some weird issues. Need to investigate.
2025-09-04 08:26:57 -06:00
Jaret Burkett
193c1b2dfa
Add a watcher to constantly check for stop signal from the UI. This will force a stop within 2 seconds instead of having to wait on a long hung process.
2025-08-31 16:58:01 -06:00
Jaret Burkett
1f541bc5d8
Changes to handle a different DFE arch
2025-08-27 11:05:16 -06:00
Jaret Burkett
aa99784b89
Add control to prompot encodings in the trainer when not cached
2025-08-21 16:52:13 -06:00
Jaret Burkett
bf2700f7be
Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere.
2025-08-21 16:41:17 -06:00
Jaret Burkett
b3e666daf4
Fix issue with wan22 14b where timesteps were generated not in the current boundary.
2025-08-16 21:16:48 -06:00
Jaret Burkett
8ea2cf00f6
Added training to the ui. Still testing, but everything seems to be working.
2025-08-16 05:51:37 -06:00
Jaret Burkett
bb6db3d635
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
2025-08-07 10:27:55 -06:00
Jaret Burkett
8d9c47316a
Work on mean flow. Minor bug fixes. Omnigen improvements
2025-06-26 13:46:20 -06:00
Jaret Burkett
18513ec866
Merged in from main
2025-06-24 10:56:54 -06:00
