Jaret Burkett 524bd2edfc Make flash attn optional. Handle larger batch sizes.

2025-04-14 14:34:46 +00:00

..

transformers

Hidream is training, but has a memory leak

2025-04-13 23:28:18 +00:00

attention_processor.py

Make flash attn optional. Handle larger batch sizes.

2025-04-14 14:34:46 +00:00

attention.py

Initial support for hidream. Still a WIP

2025-04-13 13:50:11 -06:00

embeddings.py

Initial support for hidream. Still a WIP

2025-04-13 13:50:11 -06:00

moe.py

Remove some moe stuff for finetuning. Drastically reduces vram usage

2025-04-14 00:57:34 +00:00