Multiple update from copilot
This commit is contained in:
@@ -9,7 +9,6 @@ services:
|
||||
- VLLM_MEMORY_PROFILER_ESTIMATE_CUDAGRAPHS=0
|
||||
ipc: host
|
||||
command: >
|
||||
vllm serve
|
||||
--model Qwen/Qwen2.5-14B-Instruct-AWQ
|
||||
--max-model-len 8192
|
||||
--gpu-memory-utilization 0.97
|
||||
|
||||
Reference in New Issue
Block a user