Fix : ollama provider crash, Docs : readme improvement

This commit is contained in:
martin legrand
2025-02-27 12:08:14 +01:00
parent 35022765f7
commit be22f0232e
3 changed files with 23 additions and 5 deletions
+19 -1
View File
@@ -9,9 +9,10 @@ THIS IS A WORK IN PROGRESS
- Make sure you have ollama installed on your machine
- Install dependencies (`pip3 install -r requirements.txt`)
## Run
## Run fully local
Simplest way is to use ollama
- First change the config.ini file to set the provider_name to `ollama` and provider_model to `deepseek-r1:7b`
- In first terminal run `ollama serve`
- In second terminal run `python3 main.py`
- Ollama will download `deepseek-r1:7b` on your machine
@@ -20,6 +21,23 @@ Simplest way is to use ollama
* For speech to text: `distil-whisper/distil-medium.en`
- type or say goodbye to exit.
# Run model on another machine
- First change the config.ini file to set the provider_name to `server` and provider_model to `deepseek-r1:7b` (or higher)
- On the machine that will run the model execute the script in stream_llm.py
```
python3 stream_llm.py
```
- In the config.ini file, set the provider_server_address to the ip address of the machine that will run the model.
- On the machine that will run the assistant execute main.py
```
python3 main.py
```
## Text to speech
If you want your AI to speak, run with the `--speak` option.