|
|
97d8712ba5
|
Remove single function.
|
2023-07-28 23:31:25 +02:00 |
|
|
|
97181a77c0
|
Making multiprocess require flash-attn.
|
2023-07-28 23:31:24 +02:00 |
|
|
|
7513a5e005
|
Line-up the llama implementation with the python-transformers one. (#271)
* Line-up the llama implementation with the python-transformers one.
* Also lineup the multiprocess version.
|
2023-07-28 18:31:28 +01:00 |
|
|
|
3eb2bc6d07
|
Softmax numerical stability. (#267)
* Softmax numerical stability.
* Fix the flash-attn test.
|
2023-07-28 13:13:01 +01:00 |
|
|
|
25a2086e8f
|
Putting back Send + Sync
|
2023-07-27 09:58:47 +02:00 |
|
|
|
7c7e6ba201
|
Removing inner dependency on safetensors.
|
2023-07-27 09:58:47 +02:00 |
|
|
|
ed58de7551
|
Fixed TP sharded version.
|
2023-07-27 09:58:46 +02:00 |
|
|
|
1735e4831e
|
TP sharding v2
|
2023-07-27 09:58:14 +02:00 |
|
