2 Commits

Author	SHA1	Message	Date
Jaret Burkett	58f9d01c2b	Added adafactor implementation that handles stochastic rounding of update and accumulation	2024-10-30 05:25:57 -06:00
Jaret Burkett	e72b59a8e9	Added experimental 8bit version of prodigy with stochastic rounding and stochastic gradient accumulation. Still testing.	2024-10-29 14:28:28 -06:00