stephane.david/vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True env

Browse Source
This commit is contained in:
thedarty
2026-06-19 16:23:43 +02:00
parent 9bb149acdb
commit ebbe43deb6
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docker-compose.yml
+1 -1
View File
@@ -5,7 +5,7 @@ services:
network_mode: bridge network_mode: bridge
environment: environment:
- HF_TOKEN=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 - HF_TOKEN=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
- PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True - PYTORCH_ALLOC_CONF=expandable_segments:True,throw_on_cudamalloc_oom:True
ipc: host ipc: host
ports: ports:
- "8000:8000" - "8000:8000"