Reference16r1:Concept App Service Conference Transcriptions

FIXME: This article is still work in progress

Applies To

• innovaphone Conference Transciptions from version 16r1

Overview

reference16r1_concept_app_service_conference_transcriptions_softphone_app.png/

The main goal of the Conference Transcriptions Service is to create video‑conference meeting summaries, which can be accessed in the Phone Apps.

To achieve this:

1. Users can start a transcription of the conference audio by clicking the “Transcribe Conference” button in the Phone Apps.
   • This action makes the Conference Transcriptions service connect to the conference room.
   • It records the audio and creates audio files of approximately one minute in length.
   • It forwards these small audio files via the com.innovaphone.transcriptions API, offered by the Transcriptions Service (Reference16r1:Concept_App_Service_Transcriptions)
   • It receives the transcripts of these small files and stores them in the service database.
2. If the user stops the transcription by clicking on the "Transcribe Conference" Button again
   • The Conference Transcriptions Service gathers the transcribed text from the database
   • It retrieves the prompt configured in the settings plugin Reference16r1:Apps/PbxManager/App myApps ConferenceTranscriptions
   • It sends the transcript together with the prompt to the Assistant App Service via the com.innovaphone.assistant API
   • It receives the meeting summary and stores that summary in the database of the service
3. Users may start and stop transcriptions multiple times during a meeting. As long as users remain in the room, the service recognizes that the meeting is still the same for that room.
4. After the meeting, users can find the AI‑generated meeting summary in the call list of their Phone Apps by clicking on the “i” button.
   

Licensing

In order to use the service you will need the newly introduced UCC license

Installation

Go to the Settings App (fomerly known as PBX manager) and open the "AP app installer" plugin. On the right panel, the App Store will be shown. Hint : if you access it for the first time, you will need to accept the "Terms of Use of the innovaphone App Store"

• In the search field located on the top right corner of the store, search for "Conference Transcriptions" and click on it.
• Select the proper firmware version, for example "Version 16r1" and click on install.
• Tick "I accept the terms of use" and continue by clicking on the install yellow button.
• Wait until the install has been finished.
• Close and reopen the Settings App (PBX manager) in order to refresh the list of the available colored AP plugin icons.
• Open the "AP Conference Transcriptions" Plugin by clicking on it and click on " + Add an App" and then on the "Conference Transcriptions API" button.
• Enter a "Name" (used as display name / all character allowed) and the "SIP" (no space, no capital letters). e.g : Name: Conference Transcriptions API, SIP: conference-transcriptions-api
• Choose a LLM (model) from the dropdown
• Tick the appropriate template to distribute the App (the app is needed at every user object from any user who wants to use the assistant API)
• Click OK to save the settings. A green check mark will be shown to confirm that the configuration is good.

In order to make the service work properly, two supplemental services must be installed:

• the myApps Assistant which will summarize the transcript Reference16r1:Concept App Service myApps Assistant
• the Transcriptions Service which establishes a connection to a remote transcription server Reference16r1:Concept_App_Service_Transcriptions

Conference Transcriptions - App Service

The App Service performs tasks in the following areas:

• Transcribes the audio of a conference room
• Stores the transcript in the database
• Creates and stores the summary of the transcript in the database

It can be configured in the Settings App (formerly known as PBXManager App) Reference16r1:Apps/PbxManager/App_myApps_ConferenceTranscriptions

Summary prompts

You may configure the prompt freely. Here are some propositions you may copy/paste into the corresponding field of the settings plugin:

You will receive a meeting transcript. Your task is to turn it into a structured meeting summary.

The entire summary — including section headers, bullet points, and all text — must be written in the same language as the transcript. Detect the language automatically. If the transcript is in german write the summary in german. If the transcript is in english, write the summary in english...

Follow these instructions exactly:

1. Read the transcript carefully.
2. Extract only the information that is clearly stated. Do not guess or invent anything.
3.  Create the final summary using the exact structure below, but translate the section headers into the language of the transcript.

OUTPUT FORMAT (translate the headers into the transcript language, but keep the structure):

<br>
<b>A short title describing the meeting.</b>
<br>
<br>

<b>Summary: </b>
<br>
(2–4 sentences describing the purpose of the meeting and the main outcomes.)
<br>
<br>
<b>Decisions:</b>
<br>
<br>
<ul>
<li>Decision 1</li>
<li>Decision 2</li>
<!-- Write “None mentioned” if no decisions were made. -->
</ul>
<br>
<br>
<b>Key Points:</b>
<br>
<br>
<ul>
<li>Bullet point 1</li>
<li>Bullet point 2</li>
<li>Bullet point 3</li>
 <!-- Add more if needed -->
 <!-- 2-3 sentences for each point -->
</ul>

<br>
<br>
<b>Tasks:</b>
<br>
<br>
<ul>
 <li>Person — Task — Deadline (or “No deadline mentioned”)</li>
 <!-- Add as many as needed.  Or none of none mentionned-->
</ul>
<br>
<br>
<b>Open Questions:</b>
<br>
<br>
<ul>
<li>Question 1</li>
<li>Question 2</li>
<!-- Write “None mentioned” if none. -->
</ul>

RULES:

Use HTML lists (<ul><li></li></ul>) only for bullet points.
Do not add information that is not in the transcript.
Keep the writing clear and concise.
Keep the structure exactly as shown, but translate the headers.
Do not wrap the whole answer in a single HTML tag.

TRANSCRIPT:

or a more structured version:

You will receive a meeting transcript. Your task is to turn it into a structured meeting summary.

The entire summary — including section headers, bullet points, and all text — must be written in the same language as the transcript. Detect the language automatically. If the transcript is in german write the summary in german. If the transcript is in english, write the summary in english...

Follow these instructions exactly:

1. Read the transcript carefully.
2. Extract only the information that is clearly stated. Do not guess or invent anything.
3.  Create the final summary using the exact structure below, but translate the section headers into the language of the transcript.

OUTPUT FORMAT (translate the headers into the transcript language, but keep the structure):

<br>
<b>A short title describing the meeting.</b>
<br>
<br>

<ul>
<li><b>Summary: </b></li>
<ul>
<!-- (2–4 sentences describing the purpose of the meeting and the main outcomes.) -->
<li>Sentence 1</li>
<li>Sentence 2</li>
</ul>
<br>
<br>
<li><b>Decisions:</b></li>
<ul>
<li>Decision 1</li>
<li>Decision 2</li>
<!-- Write “None mentioned” if no decisions were made. -->
</ul>
<br>
<br>
<li><b>Key Points:</b></li>
<ul>
<li>Bullet point 1</li>
<li>Bullet point 2</li>
<li>Bullet point 3</li>
 <!-- Add more if needed -->
 <!-- 2-3 sentences for each point -->
</ul>

<br>
<br>
<li><b>Tasks:</b></li>
<ul>
 <li>Person — Task — Deadline (or “No deadline mentioned”)</li>
 <!-- Add as many as needed.  Or none of none mentionned-->
</ul>
<br>
<br>
<li><b>Open Questions:</b></li>
<ul>
<li>Question 1</li>
<li>Question 2</li>
<!-- Write “None mentioned” if none. -->
</ul>
</ul>

RULES:

Use HTML lists (<ul><li></li></ul>) only for bullet points.
Do not add information that is not in the transcript.
Keep the writing clear and concise.
Keep the structure exactly as shown, but translate the headers.
Do not wrap the whole answer in a single HTML tag.
Use a normal text style. No italic.

TRANSCRIPT:

Troubleshooting

For troubleshooting the Conference Transcirptions App Service, you need activate the traceflags App, Database and HTTP-Client in your App instance.

Related Articles

• SDK Documentation - Conference Transcriptions API
• Reference16r1:Concept App Service myApps Assistant
• Reference16r1:Apps/PbxManager/App myApps ConferenceTranscriptions