Up to 7.2× the speed of standard llama.cpp Runs 100% on your PC
Free for personal use
Download free
How-to guides/Guide 03
03

Download the AI models

4 steps · about 5 minutes

The model files are big (20.3 GB and 23.8 GB), so they aren't inside the installer. 5090Ai downloads them for you, with live speed and time left, and picks up where it left off if you close the app.

You'll needAn internet connection20–50 GB free disk space
  1. Pick the model to download

    In the model chooser, a model that isn't on your PC shows its download size. Select it and click Download ….

    5090Ai
    Choose a model: both models show their download size
  2. …or start it from the chat screen

    If you skipped the chooser, the chat screen reminds you. Click Get the model.

    The model files are not installed yet: Get the model
  3. Download everything at once (optional)

    The Models page lists anything that's missing, including the knowledge model used for your documents. Click Download all to get it all in one go.

    5090Ai
    Models page: 3 models not downloaded, Download all
  4. Watch the progress

    The download monitor shows the overall progress, the speed right now, the average and peak speed, the time left and when it will finish. When a file is complete, 5090Ai checks it, then it's ready to load.

    5090Ai
    Downloading model files: 16%, speed, time left and a live speed chart
    • Pause stops the download; Resume continues it.
    • Closing 5090Ai is fine: the download resumes where it stopped next time.
    • The small badge on the Models button shows the progress from any page.

    Already have the model files on another PC or a USB drive? Copy them into the model folder (see Switch models and model storage) and click Check again.