Laurent Mazare 6a54ca115e Add some Bigcode model (#260) ...

* Start sketching the bigcode gpt model.

* Sketch the bigcode model.

* Implement the attention mechanism.

* Random reshaping.

* Sketch more of the example.

* Add some kv cache.

* Properly generate the position ids.

* Proper attention mask.

* Bail on upcasting.

* Properly apply the attention mask.

* Add the smaller starcoder variants.

* Update for the new hub api.

* Fix a shape issue.

* Fix another shape issue.

* Get some logits out.

* Adjust the weigth names.

2023-07-28 09:57:32 +01:00

..

examples

Add some Bigcode model (#260)

2023-07-28 09:57:32 +01:00

src

Add some 'cuda-if-available' helper function. (#172)

2023-07-15 08:25:15 +01:00

build.rs

Add flash attention (#241)

2023-07-26 07:48:10 +01:00

Cargo.toml

TP sharding v2

2023-07-27 09:58:14 +02:00