huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 10:38:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

Use bindgen-cuda for the custom-kernel example. (#1536)

Browse Source 
* Use bindgen-cuda for the custom-kernel example.

* Only depend on the kernels when cuda is enabled.

* Skip rustfmt.
This commit is contained in:
Laurent Mazare
2024-01-07 17:18:46 +01:00
committed by GitHub
parent 30313c3081
commit 89b5a06858
4 changed files with 20 additions and 236 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
candle-examples/examples/custom-ops/cuda_kernels.rs
View File

@ -1,2 +1 @@
#[rustfmt::skip]
pub const LAYERNORM_KERNELS: &str = include_str!(concat!(env!("OUT_DIR"), "/examples/custom-ops/kernels//layernorm_kernels.ptx"));
pub const LAYERNORM_KERNELS: &str = include_str!(concat!(env!("OUT_DIR"), "/layernorm_kernels.ptx"));

3
candle-examples/examples/custom-ops/main.rs
View File

@ -6,7 +6,8 @@
#[cfg(feature = "mkl")]
extern crate intel_mkl_src;
#[allow(unused)]
#[rustfmt::skip]
#[cfg(feature = "cuda")]
mod cuda_kernels;
use clap::Parser;