Jaret Burkett c68e58083f Add code for automagic experiment

2026-08-01 10:04:46 -06:00

..

adafactor.py

Added a basic torch profiler that can be used in config during development to find some obvious issues.

2025-06-17 13:03:39 -06:00

adam8bit.py

…

automagic2.py

Update default agreement threshold for automagic v2 to be 0.5

2026-05-26 07:57:54 -06:00

automagic3.py

Add min and max LR or automagic to prefent runaway edge cases.

2026-07-17 14:19:53 -06:00

automagic.py

…

automagicEXPERIMENT.py

Add code for automagic experiment

2026-08-01 10:04:46 -06:00

optimizer_utils.py

Added a basic torch profiler that can be used in config during development to find some obvious issues.

2025-06-17 13:03:39 -06:00

prodigy_8bit.py

Added adafactor implementation that handles stochastic rounding of update and accumulation

2024-10-30 05:25:57 -06:00

test_optimizers.py

Add code for automagic experiment

2026-08-01 10:04:46 -06:00