huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 10:38:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ca7cf5cb3bb38d1b735e1db0efdac7eea1a9d43e
candle/candle-examples/examples/mamba-minimal/README.md
Laurent Mazare 1e26d539d9 Improved mamba model optimized for inference (#1694) 
* Sketch the mamba model for inference.

* Complete the forward pass.

* Add the mamba example.

* Optimize the selective-scan part.

* Fix a couple shape mismatches and get inference to work.

* Tweak the readmes.

* More readme tweaks.
2024-02-11 17:04:57 +01:00

854 B
Raw Blame History

candle-mamba-minimal: minimal implementation of Mamba

This is based on mamba-minimal.

Compared to the mamba example, this version can handle training but is much slower.

Running the example

$ cargo run --example mamba-minimal --release -- --prompt "Mamba is the"
Mamba is the most popular and best-selling game in the world. It has been downloaded more than 1,000 times by over 1 million people worldwide since its release on March 18th 2016.

The Mamba series of games are a collection that combines elements from all genres including action, adventure, strategy & puzzle games with some unique gameplay features such as stealth and survival. The game is also known for its innovative graphics and the ability to play in a variety of different modes like single player or multiplayer.