Chat feature not visible (Ollama setup)

Gramps Web
1

Gramps 5.2.3
Gramps Web API 2.5.2
Gramps Web Frontend 24.10.0
Gramps QL 0.3.0
Sifts 1.0.0
locale: en
multi-tree: false
task queue: true
OCR: true
chat: true

Followed the instructions for setting up AI chat (minor corrections forthcoming in a PR), but when I connect to GrampsWeb I don’t see any UI related to chat. Checked all the logs and I don’t see any errors/failures related to the updated configuration, which includes the following in docker-compose.yml, in addition to setting up the Ollama service which is running successfully:

      GRAMPSWEB_LLM_BASE_URL: "http://ollama:11434/v1"
      GRAMPSWEB_LLM_MODEL: "phi3:mini"
      GRAMPSWEB_VECTOR_EMBEDDING_MODEL: "sentence-transformers/distiluse-base-multilingual-cased-v2"

In the logs the only indication that something related to the chatbot is happening are lines such as this:

2024-12-01 15:55:49 INFO:sentence_transformers.SentenceTransformer:Use pytorch device_name: cpu
2024-12-01 15:55:49 INFO:sentence_transformers.SentenceTransformer:Load pretrained SentenceTransformer: sentence-transformers/distiluse-base-multilingual-cased-v2

Is there something else I should enable to see the chat feature?

2

What do you have in settings > user management > user groups allowed to use AI chat? Perhaps “nobody”?

3

:face_with_open_eyes_and_hand_over_mouth: that’s embarrassing. I was so focused on the Admin tab that I didn’t think to look under Manage Users.

Now the UI is visible, but I’m running into some errors which I’m looking into.

1 Like