Capture of television metadata via OCR

• US 20080091713A1
• Filed: 02/14/2007
• Published: 04/17/2008
• Est. Priority Date: 10/16/2006
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Candelore, Brant L., Ozawa, Toshiro
• Application Number:
  US11/706,919
• Publication Number:
  US 20080091713A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 21/4355 involving reformatting operations of additional data, e.g. HTML pages on a television screen optimising the visualization of content for information retrieval from the Internet G06F16/9577; adaptation of message content in packet-switching networks H04L51/066; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

A method of obtaining metadata associated with television programming consistent with certain embodiments, wherein the method is carried out in a control device that does not have direct access to the metadata involves instructing an access device to generate and communicate a signal to the control device suitable for driving a display, wherein the signal contains a visual representation of a video frame of the metadata when displayed on a display; receiving the signal and storing a representation of the video frame; processing the video frame using optical character recognition (OCR) to extract the metadata from the video frame; storing the extracted metadata in a metadata database; and systematically repeating the instructing, receiving, processing and storing to sequence through a plurality of fields of video containing the metadata to access and store at least a subset of the metadata to the metadata database. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

Claims

1. A method of obtaining metadata associated with television programming, wherein the method is carried out in a control device that does not have direct access to the metadata, comprising:

instructing an access device to generate and communicate a signal to the control device suitable for driving a display, wherein the signal contains a visual representation of a video frame of the metadata when displayed on a display;

receiving the signal and storing a representation of the video frame;

processing the video frame using optical character recognition (OCR) to extract the metadata from the video frame;

storing the extracted metadata in a metadata database; and

systematically repeating the instructing, receiving, processing and storing to sequence through a plurality of fields of video containing the metadata to access and store at least a subset of the metadata to the metadata database.

2. The method according to claim 1, further comprising retrieving the extracted metadata from the metadata database and generating a user interface display therefrom that incorporates at least a portion of the metadata.

3. The method according to claim 1, wherein the subset of metadata are stored with content that the metadata describes.

4. The method according to claim 1, wherein the representation of the video frame comprises one of a compressed representation and a bitmapped representation.

5. The method according to claim 1, wherein the instructing comprises sending a one of a guide display command and an information display command to the access device.

6. The method according to claim 5, wherein in a subsequent instance of the instructing, the instructing comprises transmitting an incrementing command to either page up, page down, page left, page right, step up, step down, step left or step right, to sequence through the plurality of fields of information.

7. The method according to claim 5, wherein in a subsequent instance of the instructing, the instructing comprises issuing a command to enter an information screen associated with a television program identified in video frame.

8. The method according to claim 5, wherein information for individual television programs is represented by hierarchical layers of video frames, and wherein in a subsequent instance of the instructing, the instructing comprises issuing a command to display a frame representing a different layer in the hierarchy.

9. The method according to claim 1, wherein processing the video frame comprises processing a selected segment of the video frame using optical character recognition to extract the metadata from the video frame.

10. The method according to claim 1, wherein the OCR process is enabled to detect special symbols in the video frames.

11. The method according to claim 10, wherein the special symbols include at least one of a right arrow symbol, a left arrow symbol, a up arrow symbol, a down arrow symbol, a locked symbol, a unlocked symbol, a star symbol, a half star symbol and a pay symbol.

12. The method according to claim 1, wherein the OCR process is augmented by pattern matching to detect special symbols in the video frames.

13. The method according to claim 12, wherein the special symbols include at least one of a right arrow symbol, a left arrow symbol, a up arrow symbol, a down arrow symbol, a locked symbol, a unlocked symbol, a star symbol, a half star symbol and a pay symbol.

14. The method according to claim 12, wherein the special symbols include logos of one or more service providers or television channels.

15. The method according to claim 1, wherein the frame further includes system time and wherein the OCR process further extracts the system time.

16. The method according to claim 1, wherein the OCR process is enabled to identify foreground and background colors of text in the video frames to identify attributes associated with the video frames.

17. The method according to claim 16, wherein the attributes comprise one of a highlighted field, an attribute of a virtual channel and an attribute of a program.

19. The method according to claim 1, wherein the instructing is carried out in a manner that prioritizes obtaining metadata associated with programs designated by a user as a favorite with a highest priority.

20. A computer readable storage medium storing instructions which, when executed on a programmed processor, carry out a process according to claim 1.

21. A method of obtaining metadata associated with television programming, wherein the method is carried out in a control device that does not have direct access to the metadata, comprising:

instructing an access device to generate and communicate a signal to the control device suitable for driving a display, wherein the signal contains a visual representation of a video frame of the metadata when displayed on a display, wherein the representation of the video frame comprises one of a compressed representation and a bitmapped representation;

wherein the instructing comprises sending a one of a guide display command and an information display command to the access device;

receiving the signal and storing a representation of the video frame;

processing a selected segment of the video frame using optical character recognition (OCR) to extract the metadata, special symbols and logos from the video frame;

storing the extracted metadata in a metadata database; and

systematically repeating the instructing, receiving, processing and storing to sequence through a plurality of fields of video containing the metadata to access and store at least a subset of the metadata to the metadata database.

18. The method according to claim 29, wherein the instructing comprises transmitting of one of an infrared remote control command, an RF remote control command, a CEC compliant HDMI command, an IP protocol command or an IEEE 1394 CEA 931-B compliant command.

22. The method according to claim 21, further comprising retrieving the extracted metadata from the metadata database and generating a user interface display therefrom that incorporates at least a portion of the metadata.

23. The method according to claim 21, wherein the subset of metadata are stored with content that the metadata describes.

24. The method according to claim 21, wherein in a subsequent instance of the instructing, the instructing comprises transmitting an incrementing command to either page up, page down, page left, page right, step up, step down, step left or step right, to sequence through the plurality of fields of information.

25. The method according to claim 21, wherein in a subsequent instance of the instructing, the instructing comprises issuing a command to enter an information screen associated with a television program identified in video frame.

26. The method according to claim 21, wherein information for individual television programs is represented by hierarchical layers of video frames, and wherein in a subsequent instance of the instructing, the instructing comprises issuing a command to display a frame representing a different layer in the hierarchy.

27. The method according to claim 21, wherein the special symbols include at least one of a right arrow symbol, a left arrow symbol, a up arrow symbol, a down arrow symbol, a locked symbol, a unlocked symbol, a star symbol, a half star symbol, a pay symbol, a logo of one or more service providers and a logo of one or more television channels.

28. The method according to claim 21, wherein the frame further includes system time and wherein the OCR process further extracts the system time.

29. The method according to claim 21, wherein the OCR process is enabled to identify foreground and background colors of text in the video frames to identify attributes associated with the video frames.

30. The method according to claim 29, wherein the attributes comprise one of a highlighted field, an attribute of a virtual channel and an attribute of a program.

31. The method according to claim 21, wherein the instructing comprises transmitting of one of an infrared remote control command, an RF remote control command, a CEC compliant HDMI command, an IP protocol compliant command or an IEEE 1394 CEA 931-B compliant command.

32. The method according to claim 21, wherein the instructing is carried out in a manner that prioritizes obtaining metadata associated with programs designated by a user as a favorite with a highest priority.

33. A control device that obtains metadata associated with television programming, wherein the control device does not have direct access to the metadata, comprising:

an instruction transmitter that transmits instructions to an access device to cause the access device to generate and communicate a signal to the control device suitable for driving a display, wherein the signal contains a visual representation of a video frame of the metadata when displayed on a display;

a receiver that receives the signal;

a frame store that stores a representation of the video frame;

an optical character recognition (OCR) processing means that extracts the metadata from the video frame using character and symbol recognition;

a storage device that stores the extracted metadata in a metadata database; and

a control processor that systematically causes the control device to repeat the transmitting of instructions, receive and store the video frame, OCR process and store to the metadata database to sequence through a plurality of fields of video containing the metadata to access and store at least a subset of the metadata to the metadata database.

34. The control device according to claim 33, further comprising a user interface generator that retrieves the extracted metadata from the metadata database and generates a user interface display therefrom that incorporates at least a portion of the metadata.

35. The control device according to claim 33, wherein the subset of metadata are stored with content that the metadata describes.

36. The control device according to claim 33, wherein the instruction transmitter transmits one of a guide display command and an information display command to the access device.

37. The control device according to claim 36, wherein in a subsequent instance of transmitting the instructions, the transmitting comprises transmitting an incrementing command to either page up, page down, page left, page right, step up, step down, step left or step right, to sequence through the plurality of fields of information.

38. The control device according to claim 36, wherein in a subsequent instance of the transmitting the instructions, the transmitting comprises issuing a command to enter an information screen associated with a television program identified in video frame.

39. The control device according to claim 36, wherein information for individual television programs is represented by hierarchical layers of video frames, and wherein in a subsequent instance of the transmitting the instructions, the transmitting comprises issuing a command to display a frame representing a different layer in the hierarchy.

40. The control according to claim 33, wherein the transmitting comprises transmitting of one of an infrared remote control command, an RF remote control command, a CEC compliant HDMI command, an IP protocol compliant command, or an IEEE 1394 CEA 931-B compliant command.

41. The control device according to claim 33, wherein the OCR process is enabled to detect special symbols and highlighted colors in the video frames.