mirror of
https://github.com/huggingface/candle.git
synced 2025-06-15 10:26:33 +00:00
b54acfa3d0
* Add some tracing bits to mixformers. * Add the missing file. * Add the conv2d layer to with-tracing. * Improve the tracing usage.
candle-phi: 1.3b LLM with state of the art performance for <10b models.
Running some example
$ cargo run --example phi --release -- --prompt "def print_prime(n): "
def print_prime(n):
print("Printing prime numbers")
for i in range(2, n+1):
if is_prime(i):
print(i)
def is_prime(n):
if n <= 1:
return False
for i in range(2, int(math.sqrt(n))+1):
if n % i == 0:
return False
return True