4 Commits

Author	SHA1	Message	Date
Jaret Burkett	5f04ae7ad5	Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning.	2026-06-25 13:19:38 -06:00
Jaret Burkett	c8cd78b1a4	Allow nested transformer block names for quantization, lora targeting, quantizing	2026-06-13 14:33:16 -06:00
Jaret Burkett	fbac1cb7f5	Dont force flash attention on hidream 01. Causes random issues and is slower.	2026-05-24 16:05:22 -06:00
Jaret Burkett (Ostris)	fc4d6ebf39	Add support for fine-tuning Hidream O1 (#831) ... * Initial support for hidream. Lora keys likely need work * Fix saving for hidream-o1 * Remove dependence on flash attention for hidream o1 * Fix gradient checkpointing for hidream o1 * A lot of fixes for hidream. Handle loading and saving as comfy model. * Omit layers not used in comfy. Fix issue with lora loading keys in comfy * Version bumpo	2026-05-12 11:15:16 -06:00