VIDEO PROCESSING DEVICE FOR EMBEDDING TIME-CODED METADATA AND METHODS FOR USE THEREWITH

• US 20150033248A1
• Filed: 08/07/2014
• Published: 01/29/2015
• Est. Priority Date: 10/12/2011
• Status: Active Grant

• Current Assignee: Pixelworks Incorporated
• Original Assignee: VIXS Systems Incorporated (Pixelworks Incorporated)
• Inventors: Laksono, Indra, Pomeroy, John, Daub, Sally Jean
• Granted Patent: US 9,124,954 B2
• Time in Patent Office: Days
• US Class Current: 725/19
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 16/787 using geographical or spatial information, e.g. location
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4858 for modifying screen layout parameters, e.g. fonts, size of the windows
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/854 Content authoring
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

A video processing device includes a content analyzer that receives a video signal and generates content recognition data based on the video signal, wherein the content recognition data is associated with at least one timestamp included in the video signal. A metadata search device generates time-coded metadata in response to content recognition data and in accordance with the at least one time stamp. A metadata association device generates a processed video signal from the video signal, wherein the processed video signal includes the time-coded metadata.

Claims

1. A video processing device comprising:

a content analyzer that receives a video signal and generates content recognition data based on the video signal, wherein the content recognition data is associated with at least one timestamp included in the video signal and wherein the content recognition data includes at least one keyword generated by recognizing video content in the video signal as corresponding to the at least one keyword; and

a metadata search device, coupled to the content analyzer and at least one external source, that searches for information in response to the content recognition data and generates time-coded metadata in accordance with the at least one time stamp, the content recognition data and that includes the information, wherein the metadata search device searches the at least one external source, based on the at least one keyword, to identify the information.

2. The video processing device of claim 1 wherein the content analyzer uses speech recognition to generate the content recognition data based on a recognition of speech in audio information included in the video signal.

3. The video processing device of claim 1 wherein the content analyzer uses image recognition to generate the content recognition data based on a recognition of image data included in the video signal.

4. The video processing device of claim 1 wherein the time-coded metadata includes a universal resource locator to media that includes at least one of:

text data, audio data, video data, and image data.

5. The video processing device of claim 1 wherein the time-coded metadata includes at least one of:

text data, audio data, video data, and image data.

6. The video processing device of claim 1 wherein the metadata search device generates the information as a plurality of search results and associated relevance data and selects the time-coded metadata by comparing the associated relevance data based on a relevance threshold.

7. The video processing device of claim 1 wherein the metadata search device generates the information based on an Internet search and wherein the at least one external source includes at least one server.

8. The video processing device of claim 1 further comprising:

a metadata association device, coupled to the metadata search device, that generates a transcoded video signal from the video signal, wherein the transcoded video signal includes the time-coded metadata.

9. The video processing device of claim 8 wherein the metadata association device generates the transcoded video signal by combining the time-coded metadata with the video signal at time-coded locations.

10. A method comprising:

generating content recognition data based on a video signal, wherein the content recognition data is associated with at least one timestamp included in the video signal and wherein the content recognition data includes at least one keyword generated by recognizing video content in the video signal as corresponding to the at least one keyword; and

searching for information from at least one information source in response to the content recognition data based on the at least one keyword, and generating time-coded metadata in accordance with the at least one time stamp, the content recognition data and that includes the information.

11. The method of claim 10 wherein speech recognition is used to generate the content recognition data based on a recognition of speech in audio information included in the video signal.

12. The method of claim 10 wherein image recognition is used to generate the content recognition data based on a recognition of image data included in the video signal.

13. The method of claim 10 wherein the time-coded metadata includes a universal resource locator to media that includes at least one of:

text data, audio data, video data, and image data.

14. The method of claim 10 wherein the time-coded metadata includes at least one of:

text data, audio data, video data, and image data.

15. The method of claim 10 wherein the information includes a plurality of search results and associated relevance data and generating the time-coded metadata includes selecting the time-coded metadata by comparing the associated relevance data based on a relevance threshold.

16. The method of claim 10 further comprising:

generating a transcoded video signal from the video signal, wherein the processed video signal includes the time-coded metadata.

17. The method of claim 16 wherein the processed video signal is generated by combining the time-coded metadata with the video signal at time-coded locations in accordance with the at least one time stamp.

18. The method of claim 16 wherein the transcoded video signal includes the time-coded metadata embedded as a watermark.