Skip to content

Commit d75064e

Browse files
author
xusenlin
committed
Update docs
1 parent b28ab1e commit d75064e

File tree

1 file changed

+28
-1
lines changed

1 file changed

+28
-1
lines changed

docs/SCRIPT.md

Lines changed: 28 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ docker build -f docker/Dockerfile -t llm-api:pytorch .
1515
安装依赖
1616

1717
```shell
18-
pip install torch==1.13.1
18+
pip install torch>=1.13.1
1919
pip install -r requirements.txt
2020
```
2121

@@ -118,6 +118,12 @@ python server.py
118118

119119
**环境变量修改内容参考下面**
120120

121+
+ [deepseek](https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#deepseekchat)
122+
123+
+ [deepseek-coder](https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#deepseekcoder)
124+
125+
+ [yi-chat](https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#yi-chat)
126+
121127
+ [baichuan2](https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#baichuan2)
122128

123129
+ [code-llama](https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#code-llama)
@@ -428,3 +434,24 @@ MODEL_PATH=01-ai/Yi-34B-Chat
428434
PROMPT_NAME=yi
429435
DEVICE_MAP=auto
430436
```
437+
438+
### DeepSeekCoder
439+
440+
deepseek-ai/deepseek-coder-33b-instruct
441+
442+
```shell
443+
MODEL_NAME=deepseek-coder
444+
MODEL_PATH=deepseek-ai/deepseek-coder-33b-instruct
445+
DEVICE_MAP=auto
446+
```
447+
448+
449+
### DeepseekChat
450+
451+
deepseek-ai/deepseek-llm-67b-chat
452+
453+
```shell
454+
MODEL_NAME=deepseek
455+
MODEL_PATH=deepseek-ai/deepseek-llm-67b-chat
456+
DEVICE_MAP=auto
457+
```

0 commit comments

Comments
 (0)