Up to 7.2× the speed of standard llama.cpp Runs 100% on your PC
Free for personal use
Download free
How-to guides/Guide 11
11

Switch models and model storage

3 steps · about 3 minutes

Only one model fits on the graphics card at a time, but switching takes about 45 seconds and your chats stay as they are.

  1. Switch from the chat screen

    Click the model name at the top of the chat and choose the other model.

    The model menu: Qwen3.8-27B or Qwen3.6-35B-A3B
  2. Compare them on the Models page

    Models shows both models side by side: speed, how much faster they are than standard llama.cpp, and what each is best at. Use Switch to this model, Reload or Eject (frees the graphics card).

    5090Ai
    The Models page with both model cards
  3. Choose where the model files are stored

    The models take about 45 GB. To keep them on another drive, open Settings → Model files and click Change…. 5090Ai can move existing files for you.

    Settings, Model files: model folder, downloads and connections

    On fast internet, more download connections can speed up downloads.