Method and Apparatus for Annotating Video Content With Metadata Generated Using Speech Recognition Technology

• US 20130041664A1
• Filed: 10/17/2012
• Published: 02/14/2013
• Est. Priority Date: 05/11/2007
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: General Instrument Corporation (CommScope Holding Company, Inc.)
• Inventors: McKoen, Kevin M., Grossman, Michael A.
• Granted Patent: US 8,793,583 B2
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A method and apparatus is provided for annotating video content with metadata generated using speech recognition technology. The method begins by rendering video content on a display device. A segment of speech is received from a user such that the speech segment annotates a portion of the video content currently being rendered. The speech segment is converted to a text-segment and the text-segment is associated with the rendered portion of the video content. The text segment is stored in a selectively retrievable manner so that it is associated with the rendered portion of the video content.

Claims

1. A method for annotation of video content in a device communicatively coupled to a network, the method comprising:

receiving, in the device, a captured speech segment comprising speech from a user of a second device, wherein the captured speech segment annotates a portion of the video content streamed to the second device for being played to the user contemporaneously with the speech from the user;

converting the captured speech segment to a text-segment;

associating the text-segment with the portion of the video content contemporaneously played to the user; and

storing in a selectively retrievable manner the text-segment so that the text-segment is associated with the portion of the video content.

19. The method of claim 1 further comprising:

streaming the video content via the network to the second device.

20. The method of claim 1 further comprising:

receiving, in the device, a timestamp associated with the captured speech segment;

wherein associating the text-segment with the portion of the video content further comprises using the timestamp.

21. The method of claim 1 further comprising:

generating metadata based on the text-segment.

22. The method of claim 1 further comprising:

generating metadata based on an identified speaker associated with the speech segment.

23. The method of claim 1 further comprising:

generating metadata based on specific words of the text-segment.

24. The method of claim 1 further comprising:

receiving, in the device, before receiving the captured speech segment, a message comprising a user input selecting an operational state.

26. The method of claim 1 wherein storing the text-segment further comprises:

storing the text-segment and metadata in a database of a storage device communicatively coupled to the network.

27. The method of claim 1 wherein storing the text-segment further comprises:

storing the text-segment in a database of a storage device communicatively coupled to the network.

28. The method of claim 1 further comprising:

storing, in a database of a storage device communicatively coupled to the network, metadata comprising a timestamp for associating the text-segment with the portion of the video content.

29. The method of claim 1 further comprising:

storing, in a storage device communicatively coupled to the network, a modified version of the video content comprising metadata for associating the text-segment with the portion of the video content.

30. The method of claim 1 wherein storing the text-segment further comprises:

storing, in a storage device communicatively coupled to the network, a modified version of the video content comprising the text-segment and metadata for associating the text-segment with the portion of the video content.

2-10. -10. (canceled)

11. An apparatus for annotation of a video content, the apparatus comprising:

a memory; and

a processor communicatively coupled to the memory and to a network interface,

the processor configured to be communicatively coupled via the network interface to a network;

the processor further configured to receive, via the network interface, a captured speech segment of comprising speech from a user of a second device coupled to the network, wherein the captured speech segment annotates a portion of the video content streamed to the second device for being played to the user contemporaneously with the speech from the user;

the processor further configured to convert the captured speech segment to a text-segment, to associate the text-segment with the portion of the video content contemporaneously played to the user; and

to store in a selectively retrievable manner the text-segment so that the text-segment is associated with the portion of the video content.

12-18. -18. (canceled)

31. A method for annotation of video content in a device communicatively coupled to a network, the method comprising:

receiving, in the device, a text-segment of recognized speech comprising recognized speech from a user of a second device coupled to the network, wherein the text-segment annotates a portion of the video content streamed to the second device for being played to the user contemporaneously with the speech from the user;

associating the text-segment with the portion of the video content; and

storing in a selectively retrievable manner the text-segment so that it is associated with the portion of the video content.

32. The method of claim 31 further comprising:

streaming the video content via the network to the second device.

33. The method of claim 31 further comprising:

receiving, in the device, a timestamp associated with the captured speech segment;

wherein associating the text-segment with the portion of the video content further comprises using the timestamp.

34. A non-transitory computer-readable medium having computer-executable instructions embodied thereon for annotation of video content in a device communicatively coupled to a network, wherein the instructions, when executed by at least one processor of the device, cause the at least one processor to perform the method of claim 31.

35. A method for annotation of video content in a device communicatively coupled to a network, the method comprising:

receiving, in the device, a text-segment of recognized speech comprising recognized speech from a user of a second device, wherein the text-segment annotates a portion of the video content streamed to the second device for being played to the user contemporaneously with the speech from the user;

receiving, in the device, metadata comprising a timestamp for associating the text-segment with the portion of the video content; and

storing in a selectively retrievable manner the text-segment so that it is associated with the portion of the video content.

36. The method of claim 35 further comprising:

streaming the video content via the network to the second device.

37. The method of claim 35 further comprising:

receiving, in the device, a timestamp associated with the captured speech segment;

wherein associating the text-segment with the portion of the video content further comprises using the timestamp.

38. A non-transitory computer-readable medium having computer-executable instructions embodied thereon for annotation of video content in a device communicatively coupled to a network, wherein the instructions, when executed by at least one processor of the device, cause the at least one processor to perform the method of claim 35.