Up to 7.2× the speed of standard llama.cpp Runs 100% on your PC
Free for personal use
Download free
How-to guides/Guide 08
08

Chat with your documents (Knowledge)

6 steps · about 6 minutes

Knowledge lets 5090Ai answer from your own files, with the sources it used. Your documents are indexed on your graphics card and never leave your PC.

You'll needThe knowledge model (4.3 GB; 5090Ai offers to download it)
  1. Open Knowledge

    Click Knowledge in the menu on the left.

    5090Ai
    The Knowledge page, empty
  2. Create a collection (optional)

    Collections keep projects apart, for example "Work" and "Home". Click New collection, type a name and press Enter. Then select it.

  3. Add your files

    Click Add files or Add folder, or drag files onto the page. 5090Ai reads PDFs (including scanned pages), Word, PowerPoint, Excel, EPUB, web pages, text, Markdown, code and images.

    5090Ai
    Two PDFs added to the Contoso bikes collection, indexing
  4. Wait until they're Ready

    Indexing usually takes seconds. Each document shows Ready when it's done.

    5090Ai
    Both documents Ready
  5. Try a search (optional)

    Type a question under Try a search to see which passages it finds. It's the same search a chat uses.

    5090Ai
    Search results with matching passages
  6. Ask in a chat

    In the message box, open the Knowledge menu and choose All documents or a collection.

    Knowledge set to the Contoso bikes collection

    Ask your question. The answer quotes your documents, with numbered sources you can click to open the file.

    5090Ai
    An answer about the battery warranty, with sources