AUGMENTED REMOTE CONTROLLER, METHOD FOR OPERATING THE AUGMENTED REMOTE CONTROLLER, AND SYSTEM FOR THE SAME

• US 20110138317A1
• Filed: 12/03/2010
• Published: 06/09/2011
• Est. Priority Date: 12/04/2009
• Status: Abandoned Application

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Hwang, Sunjung, Park, Jinyung, Park, Jongsoon, Kim, Jongchul, Park, Junho, KANG, Mingoo, Kang, Haengjoon
• Application Number:
  US12/959,730
• Publication Number:
  US 20110138317A1
• Time in Patent Office: Days
• US Class Current: 715/780
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42209 for displaying non-command information, e.g. electronic program guide [EPG], e-mail, messages or a second television channel
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739

Abstract

An image display may be displayed on a remote controller based on augmented reality. An electronic device may be identified having playable content. A window may be displayed for entering a keyword related to playable content in the identified target device. A search may be performed for content that corresponds to the received keyword entered through the window. An object may be displayed that represents determined content that corresponds to the received keyword.

Claims

1. A method of controlling an image display on a remote controller based on augmented reality, the method comprising:

identifying an electronic device having playable content;

displaying, on the screen, a window for entering a keyword related to playable content in the identified target device;

receiving the keyword in the window;

searching for content that corresponds to the received keyword entered through the window; and

displaying, on the screen, at least one object that represents determined content that corresponds to the received keyword.

2. The method according to claim 1, wherein the object that represents the determined content is displayed on the screen simultaneously with an object corresponding to the identified electronic device.

3. The method according to claim 1, further comprising:

determining a location in which the determined content is stored; and

displaying, on the screen, information regarding the determined location.

4. The method according to claim 3, wherein the location is one of an image display apparatus, an external device for providing content to the image display apparatus, or a network server for providing content to the image display apparatus.

5. The method according to claim 3, further comprising:

receiving an arrangement command to arrange the at least one object representing the determined content; and

displaying the objects representing the determined content according to the determined location and in response to receiving the arrangement command.

6. The method according to claim 1, further comprising:

receiving an object selection command to select intended content to be played; and

transmitting a command to play the content when the object selection command has been received.

7. The method according to claim 6, wherein the receiving the object selection command occurs when the object is dragged toward the identified electronic device displayed on the screen.

8. The method according to claim 1, further comprising:

determining a content being played in the identified electronic device;

receiving a command to select an object included in the determined content;

searching for information related to the selected object based on the received command; and

displaying, on the screen, the determined information based on the search.

9. The method according to claim 8, wherein searching for the information comprises:

determining the object corresponding to the command from among objects included in the content played in the identified electronic device;

requesting, from the identified electronic device, additional information regarding the determined object; and

searching for the information related to the object based on the additional information regarding the object received from the electronic device.

10. The method according to claim 8, wherein displaying the determined information includes displaying an object representing the determined information at a location of the screen near the selected object.

11. The method according to claim 1, further comprising:

determining an object displayed on the identified electronic device;

determining an object in the real environment of the remote controller;

determining whether the object displayed on the identified electronic device is similar or identical to the determined object in the real environment; and

displaying, on the screen, a determination result when the object displayed on the identified electronic device is similar or identical to the identified object in the real environment.

12. The method according to claim 11, wherein determining the object displayed on the identified electronic device comprises:

capturing the object displayed on the identified electronic device;

searching for information regarding the captured object based on an image pattern of the captured object; and

determining the captured object based on the determined information.

13. The method according to claim 11, further comprising transmitting a result of the determination to the identified electronic device.

14. The method according to claim 1, further comprising changing the screen to provide an image of the identified electronic device at a center of the screen.

15. The method according to claim 14, wherein changing the screen includes enlarging the image of the identified electronic.

16. A remote controller comprising:

a wireless communication unit;

an identification unit to identify an image display apparatus about the remote controller;

a display to display a screen that includes an image of a real environment and an object that represents information related to the real environment; and

a controller to control the display to display a window for entering a keyword related to playable content in the identified electronic device, the controller to further search for content that corresponds to an entered keyword, and to display an object that represents the determined content that corresponds to the received keyword.

17. The method according to claim 16, wherein the object that represents the determined content is displayed on the screen simultaneously with an object corresponding to the identified electronic device.

18. The remote controller according to claim 16, wherein the controller determines a location in which the determined content is stored, and controls the display to display information related to the determined location.

19. The remote controller according to claim 18, wherein the location in which the determined content is stored includes an image display apparatus, an external device for providing contents to the image display apparatus, or a network server for providing contents to the image display apparatus.

20. The remote controller according to claim 18, wherein the controller determines whether an arrangement command to arrange the objects representing the contents according to the determined locations has been arranged, and controls the display to display the objects representing the contents, arranged according to the determined locations when the arrangement command has been received.