Live Transcription

Posted onby
-->


Affordable, accurate, easy-to-use speech-to-text solutions powered by people and A.I working together. Rev offers transcripts, captions, subtitles, APIs and more at low prices. Step 1: Enable Live Transcript at the Main Account Level. Log into Zoom on your Internet browser — not the app. Enable automatic speech recognition (ASR) closed captioning for your Zoom meetings by checking Enable live transcription service in the main settings under Meeting Settings and then In Meeting (Advanced). This must be done in the. With Closed Captioning enabled, the option to enable live transcription should appear directly below as Enable live transcription service to show transcript on the side panel in-meeting. Check this to enable live transcription. Starting manual closed captioning or live transcription in a meeting. AI and human transcription with industry-leading accuracy, live collaboration, search, and speaker id. Live Transcription provides robot transcription services, which enables speech to text transcription in Zoom Meetings and Zoom Webinars. This feature is enabled by the host of the meeting or webinar once it begins. Participants will not see the Live Transcript option unless the host enables it.

Live Transcription Services For Zoom

Azure Media Service delivers video, audio, and text in different protocols. When you publish your live stream using MPEG-DASH or HLS/CMAF, then along with video and audio, our service delivers the transcribed text in IMSC1.1 compatible TTML. The delivery is packaged into MPEG-4 Part 30 (ISO/IEC 14496-30) fragments. If using delivery via HLS/TS, then text is delivered as chunked VTT.

Additional charges apply when live transcription is turned on. Please review the pricing information in the Live Video section of the Media Services pricing page.

This article describes how to enable live transcription when streaming a Live Event with Azure Media Services. Before you continue, make sure you're familiar with the use of Media Services v3 REST APIs (see this tutorial for details). You should also be familiar with the live streaming concept. It's recommended to complete the Stream live with Media Services tutorial.

Live transcription preview regions and languages

Live Transcription Zoom

Live transcription is available in the following regions:

  • Southeast Asia
  • West Europe
  • North Europe
  • East US
  • Central US
  • South Central US
  • West US 2
  • Brazil South

This is the list of available languages that can be transcribed, use the language code in the API.

LanguageLanguage code
Catalanca-ES
Danish (Denmark)da-DK
German (Germany)de-DE
English (Australia)en-AU
English (Canada)en-CA
English (United Kingdom)en-GB
English (India)en-IN
English (New Zealand)en-NZ
English (United States)en-US
Spanish (Spain)es-ES
Spanish (Mexico)es-MX
Finnish (Finland)fi-FI
French (Canada)fr-CA
French (France)fr-FR
Italian (Italy)it-IT
Dutch (Netherlands)nl-NL
Portuguese (Brazil)pt-BR
Portuguese (Portugal)pt-PT
Swedish (Sweden)sv-SE
Live Transcription

Create the live event with live transcription

Live

To create a live event with the transcription turned on, send the PUT operation with the 2019-05-01-preview API version, for example:

The operation has the following body (where a pass-through Live Event is created with RTMP as the ingest protocol). Note the addition of a transcriptions property.

Start or stop transcription after the live event has started

You can start and stop live transcription while the live event is in running state. For more information about starting and stopping live events, read the Long-running operations section at Develop with Media Services v3 APIs.

To turn on live transcriptions or to update the transcription language, patch the live event to include a “transcriptions” property. To turn off live transcriptions, remove the “transcriptions” property from the live event object.

Live Transcription Software

Note

Turning the transcription on or off more than once during the live event is not a supported scenario.

This is the sample call to turn on live transcriptions.

PATCH: https://management.azure.com/subscriptions/:subscriptionId/resourceGroups/:resourceGroupName/providers/Microsoft.Media/mediaServices/:accountName/liveEvents/:liveEventName?api-version=2019-05-01-preview

Transcription delivery and playback

Review the Dynamic packaging overview article of how our service uses dynamic packaging to deliver video, audio, and text in different protocols. When you publish your live stream using MPEG-DASH or HLS/CMAF, then along with video and audio, our service delivers the transcribed text in IMSC1.1 compatible TTML. This delivery is packaged into MPEG-4 Part 30 (ISO/IEC 14496-30) fragments. If using delivery via HLS/TS, then the text is delivered as chunked VTT. You can use a web player such as the Azure Media Player to play the stream.

Note

If using Azure Media Player, use version 2.3.3 or later.

Known issues

Live

For preview, the following are known issues with live transcription:

  • Apps need to use the preview APIs, described in the Media Services v3 OpenAPI Specification.
  • Digital rights management (DRM) protection does not apply to the text track, only AES envelope encryption is possible.

Next steps