OCR input to search engine

• US 7,689,613 B2
• Filed: 03/08/2007
• Issued: 03/30/2010
• Est. Priority Date: 10/23/2006
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Candelore, Brant L.
• Primary Examiner(s): Wong; Don
• Assistant Examiner(s): Nguyen; Merilyn P
• Application Number:
  US11/715,856
• Publication Number:
  US 20080097984A1
• Time in Patent Office: 1,118 Days
• Field of Search: 707 1- 5, 707/104.1
• US Class Current: 707/707
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42213 for facilitating data entry
• CPC Class Codes: H04N 21/4332 by placing content in organized collections, e.g. local EPG data repository interfaces, Database management systems or updating for information retrieval G06F16/23; details of retrieval of video data and associated meta data in video database G06F16/739
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

A method of carrying out a search using a search engine consistent with certain embodiments involves extracting selected text from a video frame containing text by optical character recognition (OCR) processing of the selected text from the video frame; loading the text extracted from the OCR processing as a search string into a search engine; executing the search using the search engine operating on the search string; receiving search results from the search engine; and displaying the search results for viewing on a display. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

Claims

1. A method of carrying out a search of television data carried out in a television receiver device using a search engine, comprising:

at a television receiver device, receiving a command from a television remote controller device that retrieves a video frame of metadata text associated with a television program;

extracting selected portions of the metadata text from the video frame containing metadata text by optical character recognition (OCR) processing of the selected text from the video frame, the selected portions of the metadata text being selected based upon the receipt of navigation and selection commands from the television remote controller;

loading the text extracted from the OCR processing as a search string into a browser connection to an Internet search engine;

executing the search using the search engine operating on the search string;

receiving search results from the search engine; and

displaying the search results for viewing on a display associated with said television receiver device.

2. The method according to claim 1, wherein the selected text is selected by a user selecting a bitmapped region from a video display using a said remote controller to select one or more words in the video frame.

3. The method according to claim 1, wherein the selected text is selected by a user by selecting a bitmapped region from said video display using a cursor to select one or more words in the video frame, wherein the OCR processing is carried out on the selected bitmapped region after the bitmapped region is selected.

4. The method according to claim 1, wherein the selected text is identified by the location of the bitmapped region, and wherein the identified text is retrieved from a storage location storing text that was previously OCR processed.

5. The method according to claim 1, wherein the search is carried out via a modem.

6. The method according to claim 1, carried out in a television video display device.

7. The method according to claim 6, wherein the video frame produced by the video display device invoking a command to a television signal access device in order to generate a screen of descriptive metadata.

8. The method according to claim 1, wherein the video frame is produced by a control device invoking a command to a television signal access device in order to generate a screen of descriptive metadata.

9. The method according to claim 1, wherein the text is selected by a selection command that is preceded by a sequence of navigation commands.

10. A method carried out in a digital television device of carrying out a search using a search engine, comprising:

at the digital television device, instructing a digital television access device to send a frame of video containing television program metadata;

receiving instructions from a user via a television remote controller that selects text by selecting a bitmapped region of a display of the video frame;

extracting selected portions of metadata text from the video frame by optical character recognition (OCR) processing of the selected text from the video frame, the selected portions of the metadata text being selected based upon the receipt of navigation and selection commands from the television remote controller;

the digital television device loading the text extracted from the OCR processing as a search string into a browser connection to an Internet a search engine;

executing the search using the search engine operating on the search string;

receiving search results from the search engine; and

displaying the search results for viewing on a display associated with said digital television device.

11. The method according to claim 10, wherein the selected text is selected by a user by selecting a bitmapped region from a video display using a remote controller cursor control to select one or more words in the video frame, wherein the OCR processing is carried out on the selected bitmapped region after the bitmapped region is selected.

12. The method according to claim 10, wherein the selected text is identified by the location of the bitmapped region, and wherein the identified text is retrieved from a storage location storing text that was previously OCR processed.

13. The method according to claim 10, wherein the search is carried out via a modem.

14. The method according to claim 10, wherein the text is selected by a selection command that is preceded by a sequence of navigation commands.

15. A control device, comprising:

means, forming a part of a television receiver, for invoking a command to a television set top box (STB) that causes the STB to produce a frame of video containing text for display on a television video display, the text comprising metadata associated with television content;

a user interface to the television receiver that permits a user to select text from the frame of video displayed on the television video display;

a program running on a processor for extracting the selected text under user control via a remote controller from the video frame containing text by optical character recognition (OCR) processing of the selected text from the video frame;

the processor further loading the text extracted from the OCR processing as a search string for use by a browser connection to an Internet search engine;

the processor executing the search using the search engine operating on the search string; and

means for receiving search results from the search engine for display on the television video display.

16. The control device according to claim 15, wherein the selected text is selected by a user selecting a bitmapped region from a video display using a cursor control of the remote controller to select one or more words in the video frame.

17. The control according to claim 15, wherein the selected text is selected by a user by selecting a bitmapped region from a video display using a cursor control of the remote controller to select one or more words in the video frame, wherein the OCR processing is carried out on the selected bitmapped region after the bitmapped region is selected.

18. The control device according to claim 15, further comprising a storage device, and wherein the selected text is identified by the location of the bitmapped region, and wherein the identified text is retrieved from the storage device storing text that was previously OCR processed.

19. The control device according to claim 15, wherein the search is carried out via a modem.

20. The control device according to claim 15, wherein the text comprises metadata descriptive of video content.

21. A method of carrying out a search of television data carried out in a television video display device using a search engine, comprising:

at a television video display device, receiving a command from a television remote controller device that generates a video frame of metadata text associated with a television program, wherein the video frame is produced by the television video display device invoking a command to a television set top box in order to generate the video frame of metadata text;

extracting selected portions of the metadata text from the video frame containing metadata text by optical character recognition (OCR) processing of the selected text from the video frame, the selected portions of the metadata text being selected based upon the receipt of navigation and selection commands from the television remote controller, and wherein the selected text is selected by a user by selecting a bitmapped region from said video display using a cursor to select one or more words in the video frame, wherein the OCR processing is carried out on the selected bitmapped region after the bitmapped region is selected;

loading the text extracted from the OCR processing as a search string into a browser connection to an Internet search engine;

executing the search via a modem using the search engine operating on the search string;

receiving search results from the search engine; and

displaying the search results for viewing on a display associated with said television video display device.