File tree Expand file tree Collapse file tree 1 file changed +28
-1
lines changed Expand file tree Collapse file tree 1 file changed +28
-1
lines changed Original file line number Diff line number Diff line change @@ -15,7 +15,7 @@ docker build -f docker/Dockerfile -t llm-api:pytorch .
15
15
安装依赖
16
16
17
17
``` shell
18
- pip install torch= =1.13.1
18
+ pip install torch> =1.13.1
19
19
pip install -r requirements.txt
20
20
```
21
21
@@ -118,6 +118,12 @@ python server.py
118
118
119
119
** 环境变量修改内容参考下面**
120
120
121
+ + [ deepseek] ( https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#deepseekchat )
122
+
123
+ + [ deepseek-coder] ( https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#deepseekcoder )
124
+
125
+ + [ yi-chat] ( https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#yi-chat )
126
+
121
127
+ [ baichuan2] ( https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#baichuan2 )
122
128
123
129
+ [ code-llama] ( https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#code-llama )
@@ -428,3 +434,24 @@ MODEL_PATH=01-ai/Yi-34B-Chat
428
434
PROMPT_NAME=yi
429
435
DEVICE_MAP=auto
430
436
```
437
+
438
+ ### DeepSeekCoder
439
+
440
+ deepseek-ai/deepseek-coder-33b-instruct
441
+
442
+ ``` shell
443
+ MODEL_NAME=deepseek-coder
444
+ MODEL_PATH=deepseek-ai/deepseek-coder-33b-instruct
445
+ DEVICE_MAP=auto
446
+ ```
447
+
448
+
449
+ ### DeepseekChat
450
+
451
+ deepseek-ai/deepseek-llm-67b-chat
452
+
453
+ ``` shell
454
+ MODEL_NAME=deepseek
455
+ MODEL_PATH=deepseek-ai/deepseek-llm-67b-chat
456
+ DEVICE_MAP=auto
457
+ ```
You can’t perform that action at this time.
0 commit comments