Multiple update from copilot
This commit is contained in:
+1
-1
@@ -10,7 +10,7 @@ services:
|
||||
ipc: host
|
||||
command: >
|
||||
vllm serve
|
||||
Qwen/Qwen2.5-14B-Instruct-AWQ
|
||||
--model Qwen/Qwen2.5-14B-Instruct-AWQ
|
||||
--max-model-len 8192
|
||||
--gpu-memory-utilization 0.97
|
||||
ports:
|
||||
|
||||
Reference in New Issue
Block a user