Reference16r1:Concept App Service Conference Transcriptions
|
FIXME: This article is still work in progress |
Applies To
- innovaphone from version 16r1
Overview
The main goal of the conference‑transcriptions service is to create video‑conference meeting summaries, which can be accessed in the Phone Apps.
To achieve this:
- Users can start a transcription of the conference audio by clicking the “Transcribe Conference” button in the Phone Apps.
- This action makes the conference‑transcriptions service connect to the conference room.
- It records the audio and creates audio files of approximately one minute in length.
- It sends these small audio files via the com.innovaphone.transcriptions API, offered by the Transcriptions Service (Reference16r1:Concept_App_Service_Transcriptions)
- It receives the transcripts of these small files and stores them in the service database.
- If the user stops the transcription by clicking on the "Transcribe Conference" Button again
- The conference-transcriptions service gathers the transcribed text from the database
- It retrieves the prompt configured in the settings plugin Reference16r1:Apps/PbxManager/App myApps ConferenceTranscriptions
- It sends the transcript together with the prompt to the Assistant App Service via the com.innovaphone.assistant API
- It receives the meeting summary and stores that summary in the database of the service
- Users may start and stop transcriptions multiple times during a meeting. As long as users remain in the room, the service recognizes that the meeting is still the same for that room.
- After the meeting, users can find the AI‑generated meeting summary in the call list of their Phone Apps by clicking on “i”.
Licensing
Installation
Go to the Settings App (PBX manager) and open the "AP app installer" plugin. On the right panel, the App Store will be shown. Hint : if you access it for the first time, you will need to accept the "Terms of Use of the innovaphone App Store"
- In the search field located on the top right corner of the store, search for "Conference Transcriptions" and click on it
- Select the proper firmware version, for example "Version 16r1" and click on install
- Tick "I accept the terms of use" and continue by clicking on the install yellow button
- Wait until the install has been finished
- Close and reopen the Settings App (PBX manager) again in order to refresh the list of the available colored AP plugin
- Click on the "AP assistant" and click on " + Add an App" and then on the "Conference Transcriptions API" button.
- Enter a "Name" that is used as display name (all character allowed) for it and the "SIP" name that is the administrative field (no space, no capital letters). e.g : Name: Conference Transcriptions API, SIP: conference-transcriptions-api
- Choose a LLM (model) from the dropdown
- Tick the appropriate template to distribute the App (the app is needed at every user object from any user who wants to use the assistant API)
- Click OK to save the settings and a green check mark will be shown to inform you that the configuration is good
In order to make the service work properly two supplemental service must be installed:
- the myApps Assistant which will summarize the transcript Reference16r1:Concept App Service myApps Assistant
- the Transcriptions Service which establishes a connection to a remote transcription server Reference16r1:Concept_App_Service_Transcriptions
Conference Transcriptions - App Service
The App Service performs tasks in the following areas:
- Transcribes the audio of a conference room
- Stores the transcript in the database
- Creates and stores the summary of the transcript in the database
It can be configured in the Settings App (former PBXManager App) Reference16r1:Apps/PbxManager/App_myApps_ConferenceTranscriptions
Summary prompts
You may configure the prompt freely. Here are some proposition you may copy/past into the corresponding field of the settings plugin:
You will receive a meeting transcript. Your task is to turn it into a structured meeting summary. The entire summary — including section headers, bullet points, and all text — must be written in the same language as the transcript. Detect the language automatically. If the transcript is in german write the summary in german. If the transcript is in english, write the summary in english... Follow these instructions exactly: 1. Read the transcript carefully. 2. Extract only the information that is clearly stated. Do not guess or invent anything. 3. Create the final summary using the exact structure below, but translate the section headers into the language of the transcript. OUTPUT FORMAT (translate the headers into the transcript language, but keep the structure): <br> <b>A short title describing the meeting.</b> <br> <br> <b>Summary:</b> (2–4 sentences describing the purpose of the meeting and the main outcomes.) <br> <br> <b>Decisions:</b> <br> <br> <ul> <li>Decision 1</li> <li>Decision 2</li> <!-- Write “None mentioned” if no decisions were made. --> </ul> <br> <br> <b>Key Points:</b> <br> <br> <ul> <li>Bullet point 1</li> <li>Bullet point 2</li> <li>Bullet point 3</li> <!-- Add more if needed --> <!-- 2-3 sentences for each point --> </ul> <br> <br> <b>Tasks:</b> <br> <br> <ul> <li>Person — Task — Deadline (or “No deadline mentioned”)</li> <!-- Add as many as needed. Or none of none mentionned--> </ul> <br> <br> <b>Open Questions:</b> <br> <br> <ul> <li>Question 1</li> <li>Question 2</li> <!-- Write “None mentioned” if none. --> </ul> RULES: Use HTML lists (<ul><li></li></ul>) only for bullet points. Do not add information that is not in the transcript. Keep the writing clear and concise. Keep the structure exactly as shown, but translate the headers. Do not wrap the whole answer in a single HTML tag. TRANSCRIPT:
Troubleshooting
To troubleshoot this App Service, you need the traceflags App, Database, HTTP-Client in your App instance.