REMOTE CONTROL WITH WEB KEY TO INITIATE AUTOMATIC INTERNET SEARCH BASED ON CONTENT CURRENTLY DISPLAYED ON TV

• US 20130070163A1
• Filed: 09/19/2011
• Published: 03/21/2013
• Est. Priority Date: 09/19/2011
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: CONNORS, KIRSTIN
• Application Number:
  US13/236,045
• Publication Number:
  US 20130070163A1
• Time in Patent Office: Days
• US Class Current: 348/734
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/8173 End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/858 Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Abstract

A remote control (RC) for an audio video display device (AVDD) such as a TV has a special “web” key which, when pressed, causes the RC to command the TV to upload, the currently presented screen shot (or current audio, or current key words in closed captioning (CC)) to a searching device such as an Internet server, the RC processor, or the TV processor. The searching device executes a search based on images recognized in the screen shot Or audio or key words from the CC. If multiple objects are detected a list of the objects may be presented on the TV display or RC display for selection of one by the viewer. The selected object or sole recognized object is then searched using an Internet search engine and the results returned for display.

Claims

1. System, comprising:

an audio video display device (AVDD) including a video display;

a remote control (RC) wirelessly communicating user-input commands to the AVDD to control the AVDD, the RC including a Web key; and

a server communicating with the RC, wherein responsive to actuation of the Web key the RC sends a command to the AVDD to upload an image substantially currently presented on the video display for provision of the image to die server, the server responsive to receiving the image automatically executing image recognition Of objects in the image and correlating recognized objects to at least one search term searchable by an Internet search engine to return results conforming to the search term.

2. The system of claim 1, wherein responsive to deriving one and only one search term from the image, the server automatically executes an Internet search on the search term and automatically sends results of the Internet search back to the RC or AVDD or RC and AVDD.

3. The system of claim 1, wherein responsive to deriving plural search terms from the image, the server automatically sends a list of at least some of the search terms to the RC or AVDD or RC and AVDD for selection of a desired search term by a user, the server responsive to receiving the desired search term automatically executes an Internet search on the desired search term and automatically sends results of the Internet search back to the RC or AVDD or RC and AVDD.

4. The system of claim 1, wherein responsive to actuation of the Web key the RC sends a command to the AVDD to upload an image substantially currently presented on the video display to the RC for provision by the RC of the image to the server.

5. The system of claim 1, wherein responsive to actuation of the Web key the RC sends a command to the AVDD to upload an image substantially currently presented on the video display directly to the server, bypassing the RC.

6. The system of claim 1, wherein responsive to. actuation of the Web key the RC sends a command to the AVDD to upload a clip of audio being currently presented on the AVDD for provision of the clip to the server, the server responsive to receiving the clip automatically executing voice recognition of words in the clip and correlating the words to at least one search term searchable by an Internet search engine to return results conforming to the search term.

7. The system of claim 1, wherein responsive to actuation of the Web key the RC sends a command to the AVDD to upload key words in closed captioning (CC) associated with programming being currently presented on the AVDD for provision of the key words to the server, the server responsive to receiving the key words correlating the key words to at least one search term searchable by an Internet search engine to return results conforming to the search term.

8. A remote control (RC) for an audio video display device (AVDD), comprising:

housing;

“

web”

key on the housing which, when pressed, causes the RC to command the AVDD to upload at least one portion of a program being currently presented on the AVDD to a searching device for executing an internet search based on the portion of the program.

9. The RC of claim 8, wherein the portion is a screen shot of video.

10. The RC of claim 8, wherein the portion is audio.

11. The RC of claim 8, wherein the portion is at least one key word in closed captioning (CG).

12. The RC of claim 8, wherein the RC causes the RC or AVDD to present a user interface allowing a person to select among the portion being video, the portion being audio, the portion being closed captioning.

13. The RC of claim 8, wherein responsive to deriving one and only one search term from the portion an Internet search on the search term is automatically executed and results thereof presented on the RC or AVDD or on the RC and AVDD.

15. The RC of claim 8, wherein responsive to actuation of the Web key the RC sends a command to the AVDD to upload an image substantially currently presented on the video display to the RC for provision by the RC of the image to a server.

16. The RC of claim 8, wherein responsive to actuation of the Web key the RC sends a command to the AVDD to upload an image substantially currently presented on the video display directly to the server, bypassing the RC.

14. The RC of claim 81, wherein responsive to deriving plural search terms from the portion a list of at least some of the search terms is presented on the RC or AVDD or on the RC and AVDD for selection of a desired search term by a user.

17. Method, comprising:

receiving a selection signal from a Web key on a remote control (RC);

responsive to the selection signal, causing an audio video display device (AVDD) to capture a portion of content being substantially currently presented on the AVDD, the portion of content being correlated to an Internet search term and results of a search on the Internet search term being presented on the RC or AVDD.

18. The method of claim 17, wherein the portion is a screen shot of video.

19. The method of claim 17, wherein the portion is an audio clip.

20. The method of claim 17, wherein the portion is closed captioning (CC).