Update README.md

This commit is contained in:
Martin
2025-03-02 22:16:24 +01:00
committed by GitHub
parent f4b3bc788e
commit 32a9918123
+6 -6
View File
@@ -60,12 +60,6 @@ python3 main.py
### 4️⃣ **Alternative: Run the Assistant (Own Server)** ### 4️⃣ **Alternative: Run the Assistant (Own Server)**
On the other machine that will run the model execute the script in stream_llm.py
```sh
python3 stream_llm.py
```
Get the ip address of the machine that will run the model Get the ip address of the machine that will run the model
@@ -73,6 +67,12 @@ Get the ip address of the machine that will run the model
ip a | grep "inet " | grep -v 127.0.0.1 | awk '{print $2}' | cut -d/ -f1 ip a | grep "inet " | grep -v 127.0.0.1 | awk '{print $2}' | cut -d/ -f1
``` ```
On the other machine that will run the model execute the script in stream_llm.py
```sh
python3 stream_llm.py
```
Change the `config.ini` file to set the `provider_name` to `server` and `provider_model` to `deepseek-r1:7b`. Change the `config.ini` file to set the `provider_name` to `server` and `provider_model` to `deepseek-r1:7b`.
Set the `provider_server_address` to the ip address of the machine that will run the model. Set the `provider_server_address` to the ip address of the machine that will run the model.