Template:MyApps Assistant Configuration

Remote Service URL

The URL where the remote service interacting with the LLM is hosted. If you are using a model hosted by openAI, Mistral or Aleph Alpha this could be something like: https://api.openai.com/v1/chat/completions

API-Key

The secret api-key. If you are not using a self-hosted model you might need an API-Key in order to make successful HTTP Requests to your provider. This key will be delivered by your LLM model provider (e.g. openAI https://platform.openai.com/signup )

LLM Model

The actual LLM model you intend to use. There are a couple of open source models you could use. Depending on you provider this could be something like gpt-3.5-turbo, gpt-4o, luminous, mixtral-q6-8192, deepseek-r1:32b...

Apply for all users

Default model to be applied to all users. Possibility to apply individual model to users locally via Assistant App settings.

Use ollama API

The default ollama context window size may be configured to be 4096 token or to be a value adapted to the used hardware. You may safely turn that switch off, but in case the default is smaller than the texts you send to the LLM, turning that switch on will adapt the context window size to the text size send to the LLM (other LLM servers may return an error message when these additional API parameters are used).

Onboarding message

Individual message which appears on top of the Assistant application start screen.

User feedback settings

Collect user feedback: This is an option you only need to enable if you intend to train your own model with RLHF (Reinforcement Learning with Human Feedback) . Enabling that option user might vote for the LLM responses with a "like" or a "dislike" and these voting together with the data will be stored in your database.