Jaret Burkett e72b59a8e9 Added experimental 8bit version of prodigy with stochastic rounding and stochastic gradient accumulation. Still testing.

2024-10-29 14:28:28 -06:00

..

prodigy_8bit.py

Added experimental 8bit version of prodigy with stochastic rounding and stochastic gradient accumulation. Still testing.

2024-10-29 14:28:28 -06:00