OCR input to search engine

• US 20080097984A1
• Filed: 03/08/2007
• Published: 04/24/2008
• Est. Priority Date: 10/23/2006
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Candelore, Brant L.
• Granted Patent: US 7,689,613 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42213 for facilitating data entry
• CPC Class Codes: H04N 21/4332 by placing content in organized collections, e.g. local EPG data repository interfaces, Database management systems or updating for information retrieval G06F16/23; details of retrieval of video data and associated meta data in video database G06F16/739
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

A method of carrying out a search using a search engine consistent with certain embodiments involves extracting selected text from a video frame containing text by optical character recognition (OCR) processing of the selected text from the video frame; loading the text extracted from the OCR processing as a search string into a search engine; executing the search using the search engine operating on the search string; receiving search results from the search engine; and displaying the search results for viewing on a display. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

Claims

1. A method of carrying out a search using a search engine, comprising:

extracting selected text from a video frame containing text by optical character recognition (OCR) processing of the selected text from the video frame;

loading the text extracted from the OCR processing as a search string into a search engine;

executing the search using the search engine operating on the search string;

receiving search results from the search engine; and

displaying the search results for viewing on a display.

2. The method according to claim 1, wherein the selected text is selected by a user selecting a bitmapped region from a video display.

3. The method according to claim 1, wherein the selected text is selected by a user by selecting a bitmapped region from a video display, wherein the OCR processing is carried out on the selected bitmapped region after the bitmapped region is selected.

4. The method according to claim 1, wherein the selected text is identified by the location of the bitmapped region, and wherein the identified text is retrieved from a storage location storing text that was previously OCR processed.

5. The method according to claim 1, wherein the search engine comprises an Internet based search engine, and wherein the search is carried out via a modem.

6. The method according to claim 1, carried out in a video display device.

7. The method according to claim 6, wherein the video frame produced by the video display device invoking a command to an access device in order to generate a screen of descriptive metadata.

8. The method according to claim 1, wherein the video frame is produced by a control device invoking a command to an access device in order to generate a screen of descriptive metadata.

9. The method according to claim 1, wherein the text is selected by a selection command that is preceded by a sequence of navigation commands.

10. A tangible computer readable storage medium storing instructions which, when executed on a programmed processor, carry out a process according to claim 1.

11. A method carried out in a digital television device of carrying out a search using a search engine, comprising:

instructing an access device to send a frame of video containing metadata;

receiving instructions from a user that selects text by selecting a bitmapped region of a display of the video frame;

extracting selected text from a video frame by optical character recognition (OCR) processing of the selected text from the video frame;

loading the text extracted from the OCR processing as a search string into a search engine;

executing the search using the search engine operating on the search string;

receiving search results from the search engine; and

displaying the search results for viewing on a display.

12. The method according to claim 11, wherein the selected text is selected by a user by selecting a bitmapped region from a video display, wherein the OCR processing is carried out on the selected bitmapped region after the bitmapped region is selected.

13. The method according to claim 11, wherein the selected text is identified by the location of the bitmapped region, and wherein the identified text is retrieved from a storage location storing text that was previously OCR processed.

14. The method according to claim 11, wherein the search engine comprises an Internet based search engine, and wherein the search is carried out via a modem.

15. The method according to claim 11, wherein the text is selected by a selection command that is preceded by a sequence of navigation commands.

16. A control device, comprising:

means for invoking a command to an access device that causes the access device to produce a frame of video containing text for display on a video display;

a user interface that permits a user to select text from the frame of video displayed on the video display;

a program running on a processor for extracting the selected text from the video frame containing text by optical character recognition (OCR) processing of the selected text from the video frame;

the processor further loading the text extracted from the OCR processing as a search string for use by a search engine;

the processor executing the search using the search engine operating on the search string; and

means for receiving search results from the search engine for display on a display.

17. The control device according to claim 16, wherein the selected text is selected by a user selecting a bitmapped region from a video display.

18. The control according to claim 16, wherein the selected text is selected by a user by selecting a bitmapped region from a video display, wherein the OCR processing is carried out on the selected bitmapped region after the bitmapped region is selected.

19. The control device according to claim 16, further comprising a storage device, and wherein the selected text is identified by the location of the bitmapped region, and wherein the identified text is retrieved from the storage device storing text that was previously OCR processed.

20. The control device according to claim 16, wherein the search engine comprises an Internet based search engine, and wherein the search is carried out via a modem.

21. The control device according to claim 16, wherein the text comprises metadata descriptive of video content.