Reference16r1:Apps/PbxManager/App myApps Assistant
Jump to navigation
Jump to search
There are also other versions of this article available:
Reference14r2 | Reference15r1 | Reference16r1 (this version)
With the assistant settings plugin, the required app object can be created and configured. In addition, the app object can be assigned to specific config templates, if any exist.
Configuration
- Remote Service URL
- The URL where the remote service interacting with the LLM is hosted. If you are using a model hosted by openAI, Mistral or Aleph Alpha this could be something like: https://api.openai.com/v1/chat/completions
- API-Key
- The secret api-key. If you are not using a self-hosted model you might need an API-Key in order to make successful HTTP Requests to your provider. This key will be delivered by your LLM model provider (e.g. openAI https://platform.openai.com/signup )
- LLM Model
- The actual LLM model you intend to use. There are a couple of open source models you could use. Depending on you provider this could be something like gpt-3.5-turbo, gpt-4o, luminous, mixtral-q6-8192, deepseek-r1:32b...
- Apply for all users
- Default model to be applied to all users. Possibility to apply individual model to users locally via Assistant App settings.
- Use ollama API
- The default ollama context window size may be configured to be 4096 token or to be a value adapted to the used hardware. You may safely turn that switch off, but in case the default is smaller than the texts you send to the LLM, turning that switch on will adapt the context window size to the text size send to the LLM (other LLM servers may return an error message when these additional API parameters are used).
- Onboarding message
- Individual message which appears on top of the Assistant application start screen.
- User feedback settings
- Collect user feedback: This is an option you only need to enable if you intend to train your own model with RLHF (Reinforcement Learning with Human Feedback) . Enabling that option user might vote for the LLM responses with a "like" or a "dislike" and these voting together with the data will be stored in your database.
Add an app
- Assistant - application to be used for manual user queries
- Assistant API - to be used for other services
- Name
- The name displayed for the app object which must be unique.
- SIP
- The sip from the app object which must be unique.
Existing configuration templates will be listed, app objects can be assigned by checking the respective checkbox.
Be Aware: Every user who should be able to use the assistant service needs to have it assigned (by using a config template, for example).