Skip to content

Commit 6e7801d

Browse files
authored
examples : add gpt4all script (#658)
1 parent 81040f1 commit 6e7801d

File tree

1 file changed

+15
-0
lines changed

1 file changed

+15
-0
lines changed

examples/gpt4all.sh

+15
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
#!/bin/bash
2+
3+
#
4+
# Temporary script - will be removed in the future
5+
#
6+
7+
cd `dirname $0`
8+
cd ..
9+
10+
./main --color --instruct --threads 4 \
11+
--model ./models/gpt4all-7B/gpt4all-lora-quantized.bin \
12+
--file ./prompts/alpaca.txt \
13+
--batch_size 8 --ctx_size 2048 \
14+
--repeat_last_n 64 --repeat_penalty 1.3 \
15+
--n_predict 128 --temp 0.1 --top_k 40 --top_p 0.95

0 commit comments

Comments
 (0)