ai-toolkit/todo_multigpu.md at acc79956aa00100bdf5037183768cdaafa59b5aa - ai-toolkit - Gitea: Git with a cup of tea

github/ai-toolkit

Files

Jaret Burkett 5e663746b8 Working multi gpu training. Still need a lot of tweaks and testing.

2025-01-25 16:46:20 -07:00

160 B

Raw Blame History

only do ema on main device? shouldne be needed other than saving and sampling
check when to unwrap model and what it does
disable timer for non main local