Whisper2

Work in progess
Small and simple Windows desktop chat client for large language models written in Rust and Svelte. Only Ollama is currently supported, with OpenAI and RAG support in planning.

Ollama needs to be installed on your system!

Whisper2 will start Ollama at startup if it is not already running but will communicate with an already running Ollama instance if their is one.

Compiling

Install Ollama if you have not already done so.

Development:

npm run tauri dev

Release (single executable):

npm run tauri build -- --no-bundle

TODO

• Styling of assistant responses
• Persistence of chats
• Cancelation of chat completions
• Confirm opening of links generated by the assistant
• Import and Export of Chats
• Configuration of Ollama backend
• Proper dark mode
• Pulling & Deletion of Ollama models
• Support for tooling
• Support for vision models
• RAG support for local files and knowledge bases
• Support for MathML