Jaret Burkett
|
b6ff367633
|
Convrot improvements. Add argitrary bit packed byte quantizations.
|
2026-07-13 06:33:54 -06:00 |
|
Jaret Burkett
|
095d6e7418
|
Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods.
|
2026-07-11 13:49:41 -06:00 |
|
Jaret Burkett
|
933ca1c517
|
Apply w8a8 on the forward when training with convrot for more speed. Fix issue where quantizing a model had a pin memory leak.
|
2026-07-11 10:53:50 -06:00 |
|
Jaret Burkett
|
065ac27353
|
Fix issue with compiling convrot on some models
|
2026-07-11 09:26:12 -06:00 |
|
Jaret Burkett
|
96a3a06111
|
Added initial experimental support for convrot4 and convrot8 quantization.
|
2026-07-10 11:01:14 -06:00 |
|