huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-15 10:26:33 +00:00
Code Issues Packages Projects Releases Wiki Activity

Switch the default to using the faster kernels. (#1978)

Browse Source 
* Switch the default to using the faster kernels.

* Add the force-dmmv flag.
This commit is contained in:
Laurent Mazare
2024-04-01 10:00:11 +02:00
committed by GitHub
parent cd29c7ccd4
commit c7557b65dc
3 changed files with 11 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
candle-core/src/quantized/cuda.rs
View File

@ -10,7 +10,7 @@ pub struct QCudaStorage {
device: CudaDevice,
}
static FORCE_DMMV: std::sync::atomic::AtomicBool = std::sync::atomic::AtomicBool::new(true);
static FORCE_DMMV: std::sync::atomic::AtomicBool = std::sync::atomic::AtomicBool::new(false);
pub fn set_force_dmmv(f: bool) {
FORCE_DMMV.store(f, std::sync::atomic::Ordering::Relaxed)