Live Transcription

Live transcription uses automatic transcription to convert speech of all active talkers in a video session into text in real-time. It is helpful when participants have limited language proficiency or difficulty in hearing.

Live transcription is enabled by the host, like recording or screen sharing. Participants see the live transcript as subtitles under or to the side of the video. Full transcription of a session can be saved when the session is complete. The transcription process starts when the first participant requests it and stops when the last participant opts out of it. The live transcript is sent to the endpoints that have subscribed for it through notifications.

Note: Live transcription is a subscription-based service. Connect to Sales or Account Managers for subscription details.

Configuring Live Transcription Settings in a Room

Live transcription is automatically enabled in all video rooms if the subscription of this service is enabled. However, you can disable it for a particular room. You can also improve the transcription quality of the service by using the following room level settings:

  • live.transcription.language: String. Required. Language Code. The primary language of communication. For more information, see Language Codes [#language-codes).

  • live_transcription.auto_transcribe: Boolean, true or false. Default is false. Change this setting to true if you want the transcription process to start automatically when the video session starts. The live transcript is saved in a file, which is made available through the post-session API.

  • live_transcription.enable: Boolean, true or false. Default is true. If the live transcription service is subscribed, it is enabled by default. Change this setting to false if the transcription is not needed in a room.

In addition, you must be familiar with the process of creating a video room and obtaining the transcription file after the video session. For more information, see

Below is an example JSON payload for room definition with live transcription.

Example:

{
"name": "HLS Trial",
"owner_ref": "XOXO",
"settings": {
"description": "HLS Trial",
"mode": "group",
"scheduled": false,
"adhoc": false,
"duration": 30,
"moderators": "1",
"participants": "2",
"audiences": 6,
"auto_recording": false,
"quality": "SD",
"live_transcription": {
"language": "english_us",
"auto_transcribe": true,
"enable": true
}
}
}

Note: You are not permitted to define a room with live transcription settings if you have not subscribed to this service.

Methods and Notifications

In addition to auto start settings, live transcription can also be started or stopped using the SDK method calls.

When the SDK method is called to start the live transcription, it initiates the live transcription and subscribes to the feed to receive the live transcription. If the transcription process is already started in a video room, the SDK method subscribes to the process.

When a user executes the command to stop live transcription, the user is unsubscribed from the feed and does not receive the transcribed content after this point. When the last subscribed user stops subscription, the transcription process stops in the room.

If the transcription is automatically started at the room-level, the process does not stop when the last user stops. It is only stopped at the end of the session.

The methods and notifications for each SDK are individually documented. For implementation details, refer to the SDK documentation for your platform:

Language Codes

Use the following language codes while defining a room for live transcription and while using the startLiveTranscription() method of the supported SDKs:

Sl.LanguageLanguage Code
1Afrikaans (South Africa)afrikaans_sa
2Amharic (Ethiopia)amharic_et
3Arabic (United Arab Emirates)arabic_uae
4Arabic (Bahrain)arabic_bah
5Arabic (Algeria)arabic_alg
6Arabic (Egypt)arabic_egy
7Arabic (Israel)arabic_isr
8Arabic (Iraq)arabic_ira
9Arabic (Jordan)arabic_jor
10Arabic (Kuwait)arabic_kuw
11Arabic (Lebanon)arabic_leb
12Arabic (Libya)arabic_lib
13Arabic (Morocco)arabic_mor
14Arabic (Oman)arabic_oma
15Arabic (Palestinian Territories)arabic_pal
16Arabic (Qatar)arabic_qat
17Arabic (Saudi Arabia)arabic_sa
18Arabic (Syria)arabic_sy
19Arabic (Tunisia)arabic_tun
20Arabic (Yemen)arabic_yem
21Azerbaijani (Azerbaijan)azerbaijan
22Bulgarian (Bulgaria)bulgarian
23Bengali (India)bengali
24Bosnian (Bosnia)bosnian
25Catalan (Spain)catalan_esp
26Czech (Czech)czech
27Welsh (United Kingdom)welsh_uk
28Danish (Denmark)danish_da
29German (Austria)german_aus
30German (Switzerland)german_swi
31German (Germany)german_ger
32Greek (Greece)greek
33English (Australia)english_aus
34English (Canada)english_ca
35English (United Kingdom)english_uk
36English (Ghana)english_gh
37English (Hongkong)english_hg
38English (Ireland)english_ire
39English (India)english_ind
40English (Kenya)english_ken
41English (Nigeria)english_nig
42English (New Zealand)english_nz
43English (Philippines)english_phi
44English (Singapore)english_sing
45English (Tanzania)english_tanz
46English (United States)english_us
47English (South Africa)english_sa
48Spanish (Argentina)spanish_ar
49Spanish (Bolivia)spanish_bol
50Spanish (Chile)spanish_chi
51Spanish (Colombia)spanish_col
52Spanish (Costa Rica)spanish_cost
53Spanish (Cuba)spanish_cub
54Spanish (Dominican Republic)spanish_dom
55Spanish (Ecuador)spanish_ecu
56Spanish (Spain)spanish_sp
57Spanish (Equatorial Guinea)spanish_gq
58Spanish (Guatemala)spanish_gua
59Spanish (Honduras)spanish_hon
60Spanish (Mexico)spanish_mex
61Spanish (Nicaragua)spanish_nic
62Spanish (Panama)spanish_pan
63Spanish (Peru)spanish_per
64Spanish (Puerto Rico)spanish_pue
65Spanish (Paraguay)spanish_par
66Spanish (El Salvador)spanish_el
67Spanish (United States)spanish_us
68Spanish (Uruguay)spanish_urus
69Spanish (Venezuela)spanish_ven
70Estonian (Estonia)estonian
71Basquebasque
72Persian (Iran)persian
73Finnish (Finland)finnish
74Filipino (Philippines)filipino
75French (Belgium)french_bel
76French (Canada)french_can
77French (Switzerland)french_swi
78French (France)french_fra
79Irish (Ireland)irish
80Galiciangalician
81Gujarati (India)gujarati_in
82Hindi (India)hindi_in
83Croatian (Croatia)croatian
84Hungarian (Hungary)hungarian
85Armenian (Armenia)armenian
86Indonesian (Indonesia)indonesian
87Icelandic (Iceland)icelandic
88Italian (Switzerland)italy_swi
89Italian (Italy)italy
90Japanese (Japan)japanese
91Javanese (Indonesia)javanese
92Georgian (Georgia)georgian
93Kazakh (Kazakhstan)kazakh
94Khmer (Cambodia)khmer
95Kannada (India)kannada
96Korean (Korea)korean
97Lao (Laos)laos
98Lithuanian (Lithuania)lithuanian
99Latvian (Latvia)latvian
100Macedonian (Republic of North Macedonia)macedonian
101Malayalam (India)malayalam
102Mongolian (Mongolia)mongolian
103Marathi (India)marathi
104Malay (Malaysia)malay
105Maltese (Malta)maltese
106Burmese (Myanmar)burmese
107Norwegian (Bokmal, Norway)norwegian
108Nepali (Nepal)nepali
109Dutch (Belgium)dutch_bel
110Dutch (Netherlands)dutch_neth
111Polish (Poland)polish
112Pashto (Afghanistan)pashto
113Portuguese (Portugal)portuguese
114Romanian (Romania)romanian
115Russian (Russia)russian
116Sinhala (Sri Lanka)sinhala
117Slovak (Slovakia)slovak
118Slovenian (Slovenia)slovenian
119Somali (Somalia)somalix
120Albanian (Albania)albanian
121Serbian (Serbia)serbian
122Sundanese (Indonesia)sundanese
123Swedish (Sweden)swedish
124Swahili (Kenya)swahili_ken
125Swahili (Tanzania)swahili_tan
126Tamil (India)tamil_ind
127Telugu (India)telugu
128Thai (Thailand)thai
129Turkish (Turkey)turkish
130Ukrainian (Ukraine)ukrainian
131Uzbek (Uzbekistan)uzbek
132Vietnamese (Vietnam)vietnamese
133Chinese (Wu, Simplified)chinese_wu
134Chinese (Cantonese, Simplified)chinese_cant
135Chinese (Mandarin, Simplified)chinese_mand
136Chinese (Taiwanese Mandarin)chinese_tai
137Zulu (South Africa)zulu