Commit Graph

1198 Commits

Author SHA1 Message Date
Jaret Burkett
faa770fc79 Another docker thing? 2026-06-14 12:27:05 -06:00
Jaret Burkett
570c806924 Mode docker build work 2026-06-14 12:24:55 -06:00
Jaret Burkett
ebbb09230b Add requirements base to docker build 2026-06-14 12:21:28 -06:00
Jaret Burkett
5df3fb69e3 Rework Docker image for a minimal build/pull/push footprint 2026-06-14 12:19:58 -06:00
Jaret Burkett
c0d600b5d6 Allow using flash backend for ideogram 2026-06-13 15:17:20 -06:00
Jaret Burkett
c8cd78b1a4 Allow nested transformer block names for quantization, lora targeting, quantizing 2026-06-13 14:33:16 -06:00
Jaret Burkett
17c9279828 Version bump 2026-06-13 09:48:26 -06:00
Jaret Burkett
6c3b82696e Add support for PRX Pixel T2I 2026-06-13 09:47:53 -06:00
Jaret Burkett
a01c83073a Added an example model with docs so people and agents can add models easier. 2026-06-13 08:17:06 -06:00
Jaret Burkett
2f91db8363 Defauly to compiling full graph to false 2026-06-13 07:28:51 -06:00
PlagueKind
e908d85f5e Allow quantized unet offload compile and force fullgraph false (#881) 2026-06-13 07:27:28 -06:00
Jaret Burkett
0165fb2ac6 Update npm packages 2026-06-12 17:50:47 -06:00
Jaret Burkett
c90c400716 Add Ustris Cloud info to the README 2026-06-12 12:53:47 -06:00
Jaret Burkett
43b22b91ee Add a triton check on compile 2026-06-12 12:26:16 -06:00
Jaret Burkett
10e50d5797 Fix issue with casting unet after compilation 2026-06-12 12:16:51 -06:00
Jaret Burkett
d83f7dd4d9 Fix a few issues with compile. Changed defaults. Future proofed block layer compile. 2026-06-12 11:43:43 -06:00
Jaret Burkett
a5558ae7d9 Add compile to the actual right config section. 2026-06-12 11:12:41 -06:00
Jaret Burkett
c09b228a35 Add model compiling to the ui 2026-06-12 11:02:10 -06:00
PlagueKind
6b1f89f30b Enhanced torch.compile System with Block-Level Compilation and Unified Whole-Model Fallback (#866)
* Add block-level compile and qcompile torch.compile whole model  modes

* Update torch compile system
2026-06-12 10:35:12 -06:00
Rainer
324faf17b3 accept .json uploads (#880) 2026-06-12 10:31:19 -06:00
Jaret Burkett
0f580f0663 Add compiling option for captioning. Added progress bar for captioning on active job widget. Track steps on caption. Added reverse proxy iframe that plugins can use to add ui functionality. 2026-06-12 10:26:52 -06:00
Jaret Burkett
3fd14f3805 Change suporters view to an auto updating SVG file so the README doesnt need to be updated constantly. 2026-06-12 09:48:50 -06:00
Jaret Burkett
9cf34f945c Allow multi selecting jobs and deleting them in one go 2026-06-12 08:01:56 -06:00
Jaret Burkett
55ce6570f2 Automagic 3 rework. Stable in my testing. 2026-06-12 07:52:44 -06:00
fatalis
53ebb93edb fix learning rate metric truncating to zero on graph (#877) 2026-06-12 07:30:21 -06:00
Jaret Burkett
88127557f5 Comment out logging supression that was keeping weight loadings from being shown with transformers library 2026-06-11 07:53:41 -06:00
Jaret Burkett
01b6a9806b Another complete rework of automagic3. Added a decay to the LR spread to the mean to prevent LRs fighting with eachother 2026-06-09 12:08:45 -06:00
Jaret Burkett
9e99d3ce5d Save loss graph view settings per page to local storage. 2026-06-09 07:29:51 -06:00
Jaret Burkett
acb1548722 Updated the comments and doc for Automagic v3 2026-06-09 07:05:48 -06:00
Jaret Burkett
a1ac6e8b01 Reworked automagic v3 again. Seems more stable. Still testing. 2026-06-08 22:03:54 -06:00
Jaret Burkett
5d6887fd98 Major updates to automagic3 optimizer. Seems to be functioning more ideally and naturally decays, as it should. 2026-06-08 14:09:02 -06:00
Jaret Burkett
0d018db689 Rework the toggles so we can hide the trend line from the loss graph. No need for a raw toggle either. 2026-06-08 13:56:37 -06:00
Jaret Burkett
cac3815b2c Make DOP run in a single backward pass, should be faster and more stable. Show dop loss on ui 2026-06-08 13:55:47 -06:00
Jaret Burkett
687def6f7a Add better smoothing with ema rounding of the ends of the loss graph for first and last instance do not dominate the smoothing factors. 2026-06-08 10:43:46 -06:00
Jaret Burkett
d7f8887bbf Show all logged metrics on the loss graph 2026-06-08 09:43:03 -06:00
Jaret Burkett
e281df70dd Allow automagic3 to run unfused. Add some clipping. 2026-06-08 08:59:06 -06:00
Jaret Burkett
c9cdbb5bb7 Version bump 2026-06-07 16:08:11 -06:00
Jaret Burkett
c78b1404e3 Deepen offload prefetch pipeline with per-slot events
Replace the 2-slot ping-pong + single global "compute-started" event
with a depth-N ring buffer where each transfer waits only on the slot
it's reusing (D layers back) instead of the most-recent compute. Applies
to forward and backward, Linear and Conv. Depth is tunable via
AI_TOOLKIT_OFFLOAD_DEPTH (default 4).

Bit-exact vs non-offload (output, grad_input, weight grads). No speedup
on a bandwidth-bound PCIe link (already saturated at depth 2), but the
cleaner per-slot design removes the fragile shared-event serialization
and lets deeper prefetch help on faster buses.
2026-06-07 16:07:13 -06:00
Jaret Burkett
cdff6e36aa Pin inner stores of torachao to speed up layer offloading for quantized models around 25% 2026-06-07 15:52:01 -06:00
Jaret Burkett
75781fb5a5 Fix float8 weights not offloading to CPU in layer offloading 2026-06-07 15:36:17 -06:00
PlagueKind
7c1a76f336 Fix text encoder offload bug when caching embeddings (#868) 2026-06-07 14:09:32 -06:00
Jaret Burkett
35588726de Fixed issue where a buffer was stuck on cpu when offloading ideogram4 2026-06-07 13:31:03 -06:00
Jaret Burkett
1dc9a797cf Added Automagic v3 2026-06-07 12:06:42 -06:00
Jaret Burkett
82190b41e6 Fix bug where EMA was not being initialized even when setup in the config. EMA will now properly be setup and used. 2026-06-07 11:11:49 -06:00
Jaret Burkett
8968e41234 Set ideogram to use new loke saving format 2026-06-07 09:49:57 -06:00
Jaret Burkett
fa0dca288d Version bump 2026-06-06 10:24:31 -06:00
Jaret Burkett
41157b460c Added ability to set the caption extention in dataset viewer, captioner, and trainer so one dataset can have multiple caption styles in different files with different extensions. Added dataset caption template for a blank ideogram 4 formatted template. 2026-06-06 08:32:24 -06:00
Jaret Burkett
10cdeb394e Version bump 2026-06-05 14:09:46 -06:00
Jaret Burkett
21a6beb194 Allow editing the boxes visually on the sample section for ideogram 2026-06-05 14:09:18 -06:00
Jaret Burkett
4441080c05 Rework the ui of ideogram dataset image caption editor 2026-06-05 13:20:58 -06:00