Up to 7.2× the speed of standard llama.cpp Runs 100% on your PC
Free for personal use
Download free
How-to guides/Guide 12
12

Settings and choosing the GPU

3 steps · about 3 minutes

Open Settings from the menu (or press Ctrl + ,). Changes are saved automatically.

  1. Appearance

    Choose light or dark (or follow Windows), the text size and how wide conversations are. The moon/sun button at the bottom of the menu switches theme quickly.

    Appearance: theme, text size and conversation width
  2. Chat defaults

    Set default instructions for every new chat, the maximum answer length, Thinking by default, whether Enter sends, and whether to show speed statistics.

    Chat settings
  3. Load a model at start, and choose the GPU

    Turn on Load a model when the app starts to skip the chooser. If your PC has more than one graphics card, choose which RTX 5090 runs the models. Other GPUs are listed but can't be selected.

    Model settings with the GPU list