Files
candle/candle-examples/examples/phi/README.md
Laurent Mazare 912a3d63b0 Use the proper block size for quantizing models. (#933)
* Use the proper block size for quantizing models.

* Use the proper dimension.
2023-09-22 21:36:56 +01:00

24 lines
530 B
Markdown

# candle-phi: 1.3b LLM with state of the art performance for <10b models.
[phi-1.5](https://huggingface.co/microsoft/phi-1_5).
## Running some example
```bash
$ cargo run --example phi --release -- --prompt "def print_prime(n): "
def print_prime(n):
print("Printing prime numbers")
for i in range(2, n+1):
if is_prime(i):
print(i)
def is_prime(n):
if n <= 1:
return False
for i in range(2, int(math.sqrt(n))+1):
if n % i == 0:
return False
return True
```