SYSTEM AND METHOD FOR CAPTIONING MEDIA

• US 20140201631A1
• Filed: 08/19/2013
• Published: 07/17/2014
• Est. Priority Date: 01/15/2013
• Status: Active Grant

• Current Assignee: ViKi Inc. (Rakuten Group, Inc.)
• Original Assignee: ViKi Inc. (Rakuten Group, Inc.)
• Inventors: Pornprasitsakul, Nuttanart, Lee, Sunjin
• Granted Patent: US 9,696,881 B2
• Time in Patent Office: Days
• US Class Current: 715/716
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel

Abstract

A method for collaboratively captioning streamed media, the method including: rendering a visual representation of the audio at a first device, receiving segment parameters for a first media segment from the first device, rendering the visual representation of the audio at a second device, the second device different from the first device, and receiving a caption for the first media segment from the second device.

Claims

1. A method for captioning streamed media having video and audio, the method comprising:

streaming the media to a device from a remote media repository;

rendering a visual representation of the audio along a timeline of the media at the first device;

receiving segment parameters that define a media segment bounded a first timestamp and a second timestamp; and

generating a caption file comprising a caption associated with the first timestamp and the second timestamp.

2. The method of claim 1, further comprising:

streaming the media to a second device from the remote media repository; and

rendering the visual representation of the audio with icons corresponding to the first timestamp and second timestamp of the defined media segment.

3. The method of claim 2, further comprising:

receiving an annotation associated with the defined media segment from the second device; and

editing the caption file, comprising saving the annotation as a version of the caption associated with the first timestamp and the second timestamp.

4. The method of claim 3, wherein receiving an annotation comprises:

receiving a selection of the defined media segment; and

receiving the annotation at a caption input field associated with the selected media segment.

5. The method of claim 4, wherein the caption input field comprises a text input associated with a video frame within the selected media segment.

6. The method of claim 3, further comprising:

streaming the media to a third device; and

rendering the annotation for the defined media segment over video frames between the first timestamp and the second timestamp.

7. The method of claim 2, further comprising receiving a boundary change from the second device and updating the caption in the caption file with a timestamp corresponding to the changed boundary.

8. The method of claim 2, further comprising receiving segment parameters that define a second media segment bounded by a third and a fourth timestamp from the second device;

and adding the third and fourth timestamp associated with a new caption to the caption file.

9. The method of claim 1, wherein receiving segment parameters that define the media segment comprises receiving a selection of a segment of the visual representation.

10. The method of claim 9, wherein receiving a selection of a segment of the visual representation comprises:

receiving an input at the first timestamp;

playing the video and audio, starting from the first timestamp; and

detecting removal of the input and setting the second timestamp to the timestamp at which the input was removed, wherein the input is sustained during video and audio play.

11. The method of claim 10, wherein the input is a cursor selection of a position on the visual representation of the audio.

12. The method of claim 1, wherein the caption file is stored at the remote media repository.

13. A method for collaboratively captioning media including audio, the method comprising:

rendering a visual representation of the audio at a first device;

receiving segment parameters corresponding to boundaries of a first media segment from the first device;

rendering the visual representation of the audio at a second device, the second device different from the first device, the visual representation further comprising icons corresponding to the boundaries of the first media segment; and

receiving an annotation for the first media segment from the second device.

14. The method of claim 13, further comprising receiving segment parameters corresponding to boundaries of a second media segment from the second device.

15. The method of claim 13, further comprising rendering the visual representation of the audio at a third device, the third device different from the first and second device, the visual representation further comprising icons corresponding to the first and second timestamps;

rendering the annotation for the first media segment over video frames occurring between the first and second timestamps; and

receiving segment parameters corresponding to boundaries of a second media segment from the third device.

16. The method of claim 13, further comprising receiving a segment parameter change for the first media segment from the second device and updating the first media segment boundaries based on the segment parameter change.

17. The method of claim 13, wherein the segment parameters are indicative of a first timestamp and a second timestamp, wherein receiving segment parameters corresponding to boundaries of the first media segment comprises progressing the media along a timeline;

receiving a first input at a first timestamp; and

receiving a second input at the second timestamp.

18. The method of claim 13, further comprising receiving segment parameters corresponding to successive media segments from first device.

19. The method of claim 18, wherein receiving segment parameters corresponding to successive media segments from the first device comprises progressing the media along a timeline;

during sustained receipt of a first input;

receiving a second input at the first timestamp;

receiving a third input at the second timestamp; and

receiving a fourth input at a third timestamp;

wherein the first media segment is defined between the first and second timestamps, and a third media segment is defined between the second and third timestamps.

20. The method of claim 13, further comprising streaming the media to the first and second devices from a remote media repository.