mirror of
https://github.com/huggingface/candle.git
synced 2025-06-18 03:28:50 +00:00

* Some first `Module` implementations * Add `state_dict` and `load_state_dict` functionality * Move modules around and create `candle.nn.Linear` * Add `nn.Embedding` and `nn.LayerNorm` * Add BERT implementation * Batch q-matmul * Automatically dequantize `QTensors` if a `Tensor` is expected * Add Module `.to()`, `.cuda()`, `cpu()` and `.type()` functionality * Unittests for `Module`, `Tensor` and `candle.utils` * Add `pytorch` like slicing to `Tensor` * Cleanup and BERT fixes * `black` formatting + unit-test for `nn.Linear` * Refactor slicing implementation
9 lines
180 B
Python
9 lines
180 B
Python
# Generated content DO NOT EDIT
|
|
from .. import functional
|
|
|
|
gelu = functional.gelu
|
|
relu = functional.relu
|
|
silu = functional.silu
|
|
softmax = functional.softmax
|
|
tanh = functional.tanh
|