ai

The ai module contains functions for working with local and remote AI models.

Supported Models

Models can be managed in Settings ▸ AI. See AI Models for details.

The following model names are supported:

To use local models, you need to install the model files in Settings ▸ AI.

llama2-7b-chat — LLama 2 7B-Chat, chat-tuned 7B-parameter transformer model for text generation (4-bit quantized).
openchat — OpenChat, chat-tuned 7B-parameter transformer model for text generation (4-bit quantized).
neural-chat-7b — Neural Chat 7B, chat-tuned 7B-parameter transformer model for text generation (4-bit quantized).
tinyllama-chat - TinyLlama-Chat, 1.1B-parameter transformer model for text generation (5-bit quantized).

To use OpenAI models, you need to set the OpenAI API key in Settings ▸ Keys.

To use Google AI models, you need to set the Google AI API key in Settings ▸ Keys.

To use OpenRouter models, you need to set the OpenRouter API key in Settings ▸ Keys.

To use DeepSeek models, you need to set the DeepSeek API key in Settings ▸ Keys.

To use TextSynth models, you need to set the TextSynth API key in Settings ▸ Keys.

ai