Commit Graph

Select branches

Hide Pull Requests

WIP

development

kohya-sdxl

lumina2

main

multi-gpu

qwen_image_edit

sdxl

wavelet_loss

Mono Color

• 43b22b91ee Add a triton check on compile Jaret Burkett 2026-06-12 12:26:16 -06:00
• 10e50d5797 Fix issue with casting unet after compilation Jaret Burkett 2026-06-12 12:16:51 -06:00
• d83f7dd4d9 Fix a few issues with compile. Changed defaults. Future proofed block layer compile. Jaret Burkett 2026-06-12 11:43:43 -06:00
• a5558ae7d9 Add compile to the actual right config section. Jaret Burkett 2026-06-12 11:12:41 -06:00
• c09b228a35 Add model compiling to the ui Jaret Burkett 2026-06-12 11:02:10 -06:00
• 6b1f89f30b Enhanced torch.compile System with Block-Level Compilation and Unified Whole-Model Fallback (#866) PlagueKind 2026-06-12 18:35:12 +02:00
• 324faf17b3 accept .json uploads (#880) Rainer 2026-06-12 19:31:19 +03:00
• 0f580f0663 Add compiling option for captioning. Added progress bar for captioning on active job widget. Track steps on caption. Added reverse proxy iframe that plugins can use to add ui functionality. Jaret Burkett 2026-06-12 10:26:52 -06:00
• 3fd14f3805 Change suporters view to an auto updating SVG file so the README doesnt need to be updated constantly. Jaret Burkett 2026-06-12 09:48:50 -06:00
• 9cf34f945c Allow multi selecting jobs and deleting them in one go Jaret Burkett 2026-06-12 08:01:56 -06:00
• 55ce6570f2 Automagic 3 rework. Stable in my testing. Jaret Burkett 2026-06-12 07:52:44 -06:00
• 53ebb93edb fix learning rate metric truncating to zero on graph (#877) fatalis 2026-06-12 08:30:21 -05:00
• 88127557f5 Comment out logging supression that was keeping weight loadings from being shown with transformers library Jaret Burkett 2026-06-11 07:53:41 -06:00
• 01b6a9806b Another complete rework of automagic3. Added a decay to the LR spread to the mean to prevent LRs fighting with eachother Jaret Burkett 2026-06-09 12:08:45 -06:00
• 9e99d3ce5d Save loss graph view settings per page to local storage. Jaret Burkett 2026-06-09 07:29:51 -06:00
• acb1548722 Updated the comments and doc for Automagic v3 Jaret Burkett 2026-06-09 07:05:48 -06:00
• a1ac6e8b01 Reworked automagic v3 again. Seems more stable. Still testing. Jaret Burkett 2026-06-08 22:03:54 -06:00
• 5d6887fd98 Major updates to automagic3 optimizer. Seems to be functioning more ideally and naturally decays, as it should. Jaret Burkett 2026-06-08 14:09:02 -06:00
• 0d018db689 Rework the toggles so we can hide the trend line from the loss graph. No need for a raw toggle either. Jaret Burkett 2026-06-08 13:56:37 -06:00
• cac3815b2c Make DOP run in a single backward pass, should be faster and more stable. Show dop loss on ui Jaret Burkett 2026-06-08 13:55:47 -06:00
• 687def6f7a Add better smoothing with ema rounding of the ends of the loss graph for first and last instance do not dominate the smoothing factors. Jaret Burkett 2026-06-08 10:43:46 -06:00
• d7f8887bbf Show all logged metrics on the loss graph Jaret Burkett 2026-06-08 09:43:03 -06:00
• e281df70dd Allow automagic3 to run unfused. Add some clipping. Jaret Burkett 2026-06-08 08:59:06 -06:00
• c9cdbb5bb7 Version bump Jaret Burkett 2026-06-07 16:08:11 -06:00
• c78b1404e3 Deepen offload prefetch pipeline with per-slot events Jaret Burkett 2026-06-07 16:07:13 -06:00
• cdff6e36aa Pin inner stores of torachao to speed up layer offloading for quantized models around 25% Jaret Burkett 2026-06-07 15:52:01 -06:00
• 75781fb5a5 Fix float8 weights not offloading to CPU in layer offloading Jaret Burkett 2026-06-07 15:36:17 -06:00
• 7c1a76f336 Fix text encoder offload bug when caching embeddings (#868) PlagueKind 2026-06-07 22:09:32 +02:00
• 35588726de Fixed issue where a buffer was stuck on cpu when offloading ideogram4 Jaret Burkett 2026-06-07 13:31:03 -06:00
• 1dc9a797cf Added Automagic v3 Jaret Burkett 2026-06-07 12:06:42 -06:00
• 82190b41e6 Fix bug where EMA was not being initialized even when setup in the config. EMA will now properly be setup and used. Jaret Burkett 2026-06-07 11:11:49 -06:00
• 8968e41234 Set ideogram to use new loke saving format Jaret Burkett 2026-06-07 09:49:57 -06:00
• fa0dca288d Version bump Jaret Burkett 2026-06-06 10:24:31 -06:00
• 41157b460c Added ability to set the caption extention in dataset viewer, captioner, and trainer so one dataset can have multiple caption styles in different files with different extensions. Added dataset caption template for a blank ideogram 4 formatted template. Jaret Burkett 2026-06-06 08:32:24 -06:00
• 10cdeb394e Version bump Jaret Burkett 2026-06-05 14:09:46 -06:00
• 21a6beb194 Allow editing the boxes visually on the sample section for ideogram Jaret Burkett 2026-06-05 14:09:18 -06:00
• 4441080c05 Rework the ui of ideogram dataset image caption editor Jaret Burkett 2026-06-05 13:20:58 -06:00
• b70083a74f Fix issue with default sampels. Jaret Burkett 2026-06-05 12:33:42 -06:00
• c994398850 Rework prompts and captioning systems for ideogram to more strictly match the format provided by ideogram. Jaret Burkett 2026-06-05 11:14:36 -06:00
• 6fd2253932 Imporved editing boxed on the dataset viewer Jaret Burkett 2026-06-05 10:30:06 -06:00
• ef12260b80 Add a prompt upsample ui for upsampling prompts to ideogram format prompts. Jaret Burkett 2026-06-05 09:56:02 -06:00
• 90a2084f70 Allow adjusting, adding, and deleting bounding boxes. Jaret Burkett 2026-06-04 20:29:31 -06:00
• bb60f6d1d1 Show bounding boxes on the sample image card if we have them in the prompt Jaret Burkett 2026-06-04 15:59:02 -06:00
• edcc7415d1 Added an autocaptioner for Ideogram 4 captions Jaret Burkett 2026-06-04 13:04:23 -06:00
• 6a8d9333b6 Improved the prompt handeling of ideogram4 model. Now used advanced prompts class to store them smaller and allow longer prompts Jaret Burkett 2026-06-04 13:00:23 -06:00
• 2ddc2e1318 Update the default Ideogram 4 prompts to work significantly better. Jaret Burkett 2026-06-04 10:32:05 -06:00
• 63b3181262 Added experimental support for Ideogram 4 Jaret Burkett 2026-06-04 09:03:00 -06:00
• b5f21ae695 Fixed issue where the training type dropdown in the ui was not showing fully Jaret Burkett 2026-06-03 10:14:15 -06:00
• d9f26c2f87 Add gradient checkpointing to tipsv2 heads Jaret Burkett 2026-06-01 05:00:15 -06:00
• bd468727a6 Fixed issue where some image cards in samples and datasets would show gray instead of the image until you scroll. Jaret Burkett 2026-06-01 03:36:32 -06:00
• f5446c0d5f Version bump Jaret Burkett 2026-06-01 02:16:47 -06:00
• e5439509b5 Added pure lpips dfe Jaret Burkett 2026-05-31 11:52:03 -06:00
• 212cfe998a Add ability to download or delete the optimizer state from the ui Jaret Burkett 2026-05-29 08:56:22 -06:00
• 5e84bf0d0b Fixed issue with hidream-01 that could cause a weird nan state. Took forever to track down as it was 1 in 10 starts. Jaret Burkett 2026-05-28 12:48:24 -06:00
• 87bac27513 Fixed issue with new bucket scaler Jaret Burkett 2026-05-28 11:34:16 -06:00
• 30886b8f92 Added a wallet indicator for Ostris Cloud Jaret Burkett 2026-05-28 11:09:51 -06:00
• 3e86d81fc6 Adjust bucket sizes to achieve maximum pixels without going over. Jaret Burkett 2026-05-28 09:36:17 -06:00
• ef57c1077c Change z image divisibility Jaret Burkett 2026-05-28 09:09:36 -06:00
• 15082cfb8a Round buckets for divisibility instead of always rounding down. Jaret Burkett 2026-05-28 09:08:21 -06:00
• c9264bdd0b Reworked the bucketing system to precisly match model specific divisibility. The old SDXL bucket sizes needed to go. Jaret Burkett 2026-05-28 08:35:58 -06:00
• 68e9b38220 Add ability to trigger a save from the ui which whill make the trainer save on the next step Jaret Burkett 2026-05-26 08:38:49 -06:00
• 2aa60e4ca5 Update default agreement threshold for automagic v2 to be 0.5 Jaret Burkett 2026-05-26 07:57:54 -06:00
• 76c99da4e4 Add version to the ui Jaret Burkett 2026-05-26 07:30:09 -06:00
• 266956068a Add a way to delete checkpoints on the ui Jaret Burkett 2026-05-26 07:09:21 -06:00
• 954c5efec8 Show job info on sidebar active job in ui Jaret Burkett 2026-05-25 11:07:29 -06:00
• 083236a2a7 Drastically improve the loading speed of images in the ui by using a custom loader and abort controller to abort when images leave the view. Jaret Burkett 2026-05-25 10:04:25 -06:00
• 7354def271 Added decode latent method to qwen image model Jaret Burkett 2026-05-25 10:02:09 -06:00
• 3d836ac371 Show active jobs in the sidebar of the ui Jaret Burkett 2026-05-25 08:21:42 -06:00
• a798e06dd2 Updated the support button to look more like a button Jaret Burkett 2026-05-25 07:48:04 -06:00
• 8042cbe9d2 Added virtulization for sample images to handle huge number of samples more efficientyly. Jaret Burkett 2026-05-25 07:22:24 -06:00
• fbac1cb7f5 Dont force flash attention on hidream 01. Causes random issues and is slower. Jaret Burkett 2026-05-24 16:05:22 -06:00
• 307ff11bc5 Drastically improved the performance of the dataset viewer on large datasets by switching to virtualization. Fixed issue with images loading when they have two periods in a row .. Jaret Burkett 2026-05-24 15:13:55 -06:00
• c6a7e81a70 Added a dataset image viewer. Fixed an issue where captions would show as not saved when they were saved. Jaret Burkett 2026-05-24 14:31:06 -06:00
• 12304e170f Added some experimental loss targets Jaret Burkett 2026-05-24 14:13:23 -06:00
• 644a6f9246 Fix device casting for zimage in some instances Jaret Burkett 2026-05-23 10:37:33 -06:00
• c6ecc03ccd Fixed saving full model of z_image l2p for finetuning Jaret Burkett 2026-05-23 07:36:24 -06:00
• 6102370df9 Add support for ZImage L2P Jaret Burkett 2026-05-22 14:58:28 -06:00
• 6fc08a8928 Fix issue with saving images from new sample viewer Jaret Burkett 2026-05-22 11:58:32 -06:00
• 5579837c3f Add hidream o1 to the readme Jaret Burkett 2026-05-21 07:56:54 -06:00
• aecd554128 Add sapiens2 matting as a mask generator. Begin transition to model paths and model folders. Jaret Burkett 2026-05-20 08:56:16 -06:00
• 15d4fb89ff Fixed overflow issue on modal Jaret Burkett 2026-05-19 10:12:43 -06:00
• df851b3497 Made the UI mobile friendly, finally... Jaret Burkett 2026-05-19 09:27:36 -06:00
• 6ecaf679dc Add ability to run small scripts from the ui and added a merge lora script Jaret Burkett 2026-05-18 14:33:47 -06:00
• ec58dcde92 Add better gradient checkpointing to dfes Jaret Burkett 2026-05-18 09:25:23 -06:00
• b42acb988f Remove future steps from loss log if resuming from an earlier step Jaret Burkett 2026-05-18 09:23:55 -06:00
• e03c6e4dc9 Fix potential inconsistency with different attention mentods in hidream01 Jaret Burkett 2026-05-13 09:08:11 -06:00
• 4bfe944792 Scale dfe 7 with velocity_equiv_weight Jaret Burkett 2026-05-13 09:06:59 -06:00
• fc4d6ebf39 Add support for fine-tuning Hidream O1 (#831) Jaret Burkett (Ostris) 2026-05-12 11:15:16 -06:00
• f38de2a2fe Add tipsv2 locally and fix gradient checkpointing for it Jaret Burkett 2026-05-10 14:47:44 -06:00
• d144cb5ea6 Switch to uplot for loss graph and rework performance of graph. It is significantly more perfromant now. Jaret Burkett 2026-05-07 07:38:00 -06:00
• a12ddd72a1 Change the velocity weight cap on dfe 9 Jaret Burkett 2026-05-07 07:37:05 -06:00
• 6bb8acbffc Add agreement_threshold default of 0.6 to automagic 2 Jaret Burkett 2026-05-05 19:13:00 -06:00
• 963a9f42b2 Add decode latent to wan 2.1 models. Add gradinet checkpointing to wan vae. Jaret Burkett 2026-05-05 11:30:16 -06:00
• 4260a3c5b6 Add optimizer test suite and make minor speed adjustments to Automagicv2 Jaret Burkett 2026-05-05 10:02:30 -06:00
• aeca7fe404 Add Automagic v2 optimizer. It uses significantly less vram and is much more efficient. Jaret Burkett 2026-05-05 09:09:07 -06:00
• 0d91fcee9e Allow edit of captioning job Jaret Burkett 2026-04-30 16:00:16 -06:00
• eadc9a58af Version bump Jaret Burkett 2026-04-30 06:00:58 -06:00
• e9ab387dfd Fixed issue with qwen image edit models when using multiple control images when not caching text embeddings. Jaret Burkett 2026-04-30 11:59:12 +00:00
• deb409085a Made it possible to use the flux 2 small decoder VAE when setting the vae_path manually for flux2 models Jaret Burkett 2026-04-30 05:42:31 -06:00
• 7ccec8ec2c Add checkpointing and a proper decode for flux 2 VAEs so they can be used with DFE Jaret Burkett 2026-04-30 04:27:13 -06:00