Live Transcription
Live transcription uses automatic transcription to convert speech of all active talkers in a video session into text in real-time. It is helpful when participants have limited language proficiency or difficulty in hearing.
Live transcription is enabled by the host, like recording or screen sharing. Participants see the live transcript as subtitles under or to the side of the video. Full transcription of a session can be saved when the session is complete. The transcription process starts when the first participant requests it and stops when the last participant opts out of it. The live transcript is sent to the endpoints that have subscribed for it through notifications.
Note: Live transcription is a subscription-based service. Connect to Sales or Account Managers for subscription details.
Configuring Live Transcription Settings in a Room
Live transcription is automatically enabled in all video rooms if the subscription of this service is enabled. However, you can disable it for a particular room. You can also improve the transcription quality of the service by using the following room level settings:
-
live.transcription.language
: String. Required. Language Code. The primary language of communication. For more information, see Language Codes [#language-codes). -
live_transcription.auto_transcribe
: Boolean, true or false. Default is false. Change this setting to true if you want the transcription process to start automatically when the video session starts. The live transcript is saved in a file, which is made available through the post-session API. -
live_transcription.enable
: Boolean, true or false. Default is true. If the live transcription service is subscribed, it is enabled by default. Change this setting to false if the transcription is not needed in a room.
In addition, you must be familiar with the process of creating a video room and obtaining the transcription file after the video session. For more information, see
Below is an example JSON payload for room definition with live transcription.
Example:
{"name": "HLS Trial","owner_ref": "XOXO","settings": {"description": "HLS Trial","mode": "group","scheduled": false,"adhoc": false,"duration": 30,"moderators": "1","participants": "2","audiences": 6,"auto_recording": false,"quality": "SD","live_transcription": {"language": "english_us","auto_transcribe": true,"enable": true}}}
Note: You are not permitted to define a room with live transcription settings if you have not subscribed to this service.
Methods and Notifications
In addition to auto start settings, live transcription can also be started or stopped using the SDK method calls.
When the SDK method is called to start the live transcription, it initiates the live transcription and subscribes to the feed to receive the live transcription. If the transcription process is already started in a video room, the SDK method subscribes to the process.
When a user executes the command to stop live transcription, the user is unsubscribed from the feed and does not receive the transcribed content after this point. When the last subscribed user stops subscription, the transcription process stops in the room.
If the transcription is automatically started at the room-level, the process does not stop when the last user stops. It is only stopped at the end of the session.
The methods and notifications for each SDK are individually documented. For implementation details, refer to the SDK documentation for your platform:
Language Codes
Use the following language codes while defining a room for live transcription and while using the startLiveTranscription() method of the supported SDKs:
Sl. | Language | Language Code |
---|---|---|
1 | Afrikaans (South Africa) | afrikaans_sa |
2 | Amharic (Ethiopia) | amharic_et |
3 | Arabic (United Arab Emirates) | arabic_uae |
4 | Arabic (Bahrain) | arabic_bah |
5 | Arabic (Algeria) | arabic_alg |
6 | Arabic (Egypt) | arabic_egy |
7 | Arabic (Israel) | arabic_isr |
8 | Arabic (Iraq) | arabic_ira |
9 | Arabic (Jordan) | arabic_jor |
10 | Arabic (Kuwait) | arabic_kuw |
11 | Arabic (Lebanon) | arabic_leb |
12 | Arabic (Libya) | arabic_lib |
13 | Arabic (Morocco) | arabic_mor |
14 | Arabic (Oman) | arabic_oma |
15 | Arabic (Palestinian Territories) | arabic_pal |
16 | Arabic (Qatar) | arabic_qat |
17 | Arabic (Saudi Arabia) | arabic_sa |
18 | Arabic (Syria) | arabic_sy |
19 | Arabic (Tunisia) | arabic_tun |
20 | Arabic (Yemen) | arabic_yem |
21 | Azerbaijani (Azerbaijan) | azerbaijan |
22 | Bulgarian (Bulgaria) | bulgarian |
23 | Bengali (India) | bengali |
24 | Bosnian (Bosnia) | bosnian |
25 | Catalan (Spain) | catalan_esp |
26 | Czech (Czech) | czech |
27 | Welsh (United Kingdom) | welsh_uk |
28 | Danish (Denmark) | danish_da |
29 | German (Austria) | german_aus |
30 | German (Switzerland) | german_swi |
31 | German (Germany) | german_ger |
32 | Greek (Greece) | greek |
33 | English (Australia) | english_aus |
34 | English (Canada) | english_ca |
35 | English (United Kingdom) | english_uk |
36 | English (Ghana) | english_gh |
37 | English (Hongkong) | english_hg |
38 | English (Ireland) | english_ire |
39 | English (India) | english_ind |
40 | English (Kenya) | english_ken |
41 | English (Nigeria) | english_nig |
42 | English (New Zealand) | english_nz |
43 | English (Philippines) | english_phi |
44 | English (Singapore) | english_sing |
45 | English (Tanzania) | english_tanz |
46 | English (United States) | english_us |
47 | English (South Africa) | english_sa |
48 | Spanish (Argentina) | spanish_ar |
49 | Spanish (Bolivia) | spanish_bol |
50 | Spanish (Chile) | spanish_chi |
51 | Spanish (Colombia) | spanish_col |
52 | Spanish (Costa Rica) | spanish_cost |
53 | Spanish (Cuba) | spanish_cub |
54 | Spanish (Dominican Republic) | spanish_dom |
55 | Spanish (Ecuador) | spanish_ecu |
56 | Spanish (Spain) | spanish_sp |
57 | Spanish (Equatorial Guinea) | spanish_gq |
58 | Spanish (Guatemala) | spanish_gua |
59 | Spanish (Honduras) | spanish_hon |
60 | Spanish (Mexico) | spanish_mex |
61 | Spanish (Nicaragua) | spanish_nic |
62 | Spanish (Panama) | spanish_pan |
63 | Spanish (Peru) | spanish_per |
64 | Spanish (Puerto Rico) | spanish_pue |
65 | Spanish (Paraguay) | spanish_par |
66 | Spanish (El Salvador) | spanish_el |
67 | Spanish (United States) | spanish_us |
68 | Spanish (Uruguay) | spanish_urus |
69 | Spanish (Venezuela) | spanish_ven |
70 | Estonian (Estonia) | estonian |
71 | Basque | basque |
72 | Persian (Iran) | persian |
73 | Finnish (Finland) | finnish |
74 | Filipino (Philippines) | filipino |
75 | French (Belgium) | french_bel |
76 | French (Canada) | french_can |
77 | French (Switzerland) | french_swi |
78 | French (France) | french_fra |
79 | Irish (Ireland) | irish |
80 | Galician | galician |
81 | Gujarati (India) | gujarati_in |
82 | Hindi (India) | hindi_in |
83 | Croatian (Croatia) | croatian |
84 | Hungarian (Hungary) | hungarian |
85 | Armenian (Armenia) | armenian |
86 | Indonesian (Indonesia) | indonesian |
87 | Icelandic (Iceland) | icelandic |
88 | Italian (Switzerland) | italy_swi |
89 | Italian (Italy) | italy |
90 | Japanese (Japan) | japanese |
91 | Javanese (Indonesia) | javanese |
92 | Georgian (Georgia) | georgian |
93 | Kazakh (Kazakhstan) | kazakh |
94 | Khmer (Cambodia) | khmer |
95 | Kannada (India) | kannada |
96 | Korean (Korea) | korean |
97 | Lao (Laos) | laos |
98 | Lithuanian (Lithuania) | lithuanian |
99 | Latvian (Latvia) | latvian |
100 | Macedonian (Republic of North Macedonia) | macedonian |
101 | Malayalam (India) | malayalam |
102 | Mongolian (Mongolia) | mongolian |
103 | Marathi (India) | marathi |
104 | Malay (Malaysia) | malay |
105 | Maltese (Malta) | maltese |
106 | Burmese (Myanmar) | burmese |
107 | Norwegian (Bokmal, Norway) | norwegian |
108 | Nepali (Nepal) | nepali |
109 | Dutch (Belgium) | dutch_bel |
110 | Dutch (Netherlands) | dutch_neth |
111 | Polish (Poland) | polish |
112 | Pashto (Afghanistan) | pashto |
113 | Portuguese (Portugal) | portuguese |
114 | Romanian (Romania) | romanian |
115 | Russian (Russia) | russian |
116 | Sinhala (Sri Lanka) | sinhala |
117 | Slovak (Slovakia) | slovak |
118 | Slovenian (Slovenia) | slovenian |
119 | Somali (Somalia) | somalix |
120 | Albanian (Albania) | albanian |
121 | Serbian (Serbia) | serbian |
122 | Sundanese (Indonesia) | sundanese |
123 | Swedish (Sweden) | swedish |
124 | Swahili (Kenya) | swahili_ken |
125 | Swahili (Tanzania) | swahili_tan |
126 | Tamil (India) | tamil_ind |
127 | Telugu (India) | telugu |
128 | Thai (Thailand) | thai |
129 | Turkish (Turkey) | turkish |
130 | Ukrainian (Ukraine) | ukrainian |
131 | Uzbek (Uzbekistan) | uzbek |
132 | Vietnamese (Vietnam) | vietnamese |
133 | Chinese (Wu, Simplified) | chinese_wu |
134 | Chinese (Cantonese, Simplified) | chinese_cant |
135 | Chinese (Mandarin, Simplified) | chinese_mand |
136 | Chinese (Taiwanese Mandarin) | chinese_tai |
137 | Zulu (South Africa) | zulu |