METHOD, TERMINAL AND COMPUTER-READABLE RECORDING MEDIUM FOR PERFORMING VISUAL SEARCH BASED ON MOVEMENT OR POSITION OF TERMINAL

• US 20120075345A1
• Filed: 09/06/2010
• Published: 03/29/2012
• Est. Priority Date: 10/01/2009
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Olaworks, Inc. (Intel Corporation)
• Inventors: Lee, Kyoung Suk, Choi, Young Il, Ju, Chan Jin, Ryu, Jung Hee
• Application Number:
  US13/375,215
• Publication Number:
  US 20120075345A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/904 Browsing; Visualisation therefor for navigating the web G06F16/954; browsing optimisation for the web G06F16/957
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

The present invention includes a method for performing visual search based on a movement and/or an angular position of a terminal. The method includes the steps of: (a) sensing a movement and/or an angular position of a terminal by using at least one of sensors; (b) determining whether a triggering event occurs or not by referring to at least one of the sensed movement and the sensed angular position of the terminal; and (c) if the triggering event occurs, allowing visual search to be performed for at least one of objects included in an output image displayed on the terminal at the time of the occurrence of the triggering event; wherein the output image is generated in a form of augmented reality by combining an image inputted through the terminal in real time with information relevant thereto.

Claims

1. A method for performing visual search based on a movement and/or an angular position of a terminal comprising the steps of:

(a) sensing a movement and/or an angular position of a terminal by using at least one sensor;

(b) determining whether a triggering event has occurred by referring to at least one of the sensed movement and the sensed angular position of the terminal; and

(c) where the triggering event has occurred, allowing a visual search to be performed for at least an object included in an output image displayed on the terminal at the time of the occurrence of the triggering event;

wherein the output image is generated in a form of augmented reality by combining an image inputted through the terminal in real time with information relevant thereto.

2. The method of claim 1, wherein the triggering event includes at least one of the following events:

a first event of the terminal moving by a prefixed pattern, a second event of the terminal stopping moving for a predefined period of time, and a third event of the terminal taking a pre-established angular position.

3. The method of claim 2, wherein the prefixed pattern is specified by at least one of the following factors:

the terminal'"'"'s moving distance, velocity, acceleration and moving direction.

4. The method of claim 2, wherein the pre-established angular position is specified by an angle at which the terminal is tilted to at least one of axes.

5. The method of claim 1, wherein, at the step (c), the at least an object includes a top n objects displayed on the output image closer to the center thereof.

6. The method of claim 1, wherein, at the step (c), the visual search is performed by a remote operation equipment communicable with the terminal.

7. The method of claim 1, further comprising the step of:

(d) providing information on at least one of the objects obtained as a result of performing the visual search.

8. The method of claim 7, wherein, at the step of (d), the image inputted by the terminal overlaid with the information on at least one of the objects is formed and provided in a form of augmented reality.

17. The method of claim 1, wherein, when a key is inputted at a first angular position of the terminal as a first triggering event, a retrieval of information around a location of the terminal is performed at the time of the occurrence of the first triggering event;

and when another key is inputted at a second angular position of the terminal as a second triggering event, said visual search for said at least an object included on the output image displayed through the terminal is performed at the time of the occurrence of the second triggering event.

18. The method of claim 7, wherein the step (d) includes the steps of:

(d1) sensing the movement and/or the angular position of the terminal by using said at least one sensor;

(d2) determining whether a triggering event has occurred by referring to at least one of the sensed movement of the terminal and the sensed angular position thereof; and

(d3) when the triggering event for controlling the output image occurs, changing at least one of a method of displaying information on objects and an information type.

21. A medium recording a computer readable program to execute the method of claim 1.

9. A terminal for performing visual search based on a movement and/or angular position thereof comprising:

a movement and/or angular position sensing part for sensing information on a movement and/or angular position thereof by using at least one sensor;

a triggering event identifying part for determining when a triggering event has occurred by referring to at least one of the sensed movement and the sensed angular position thereof; and

a visual search part for performing a visual search for at least an object included in an output image displayed thereon when the triggering event occurs;

wherein the output image is generated in a form of augmented reality by combining an image inputted therethrough in real time with information relevant thereto.

10. The terminal of claim 9, wherein the triggering event includes at least one of the following events:

a first event of moving by a prefixed pattern, a second one of stopping moving for a predefined period of time, and a third one of taking a pre-established angular position.

11. The terminal of claim 10, wherein the prefixed pattern is specified by at least one of the following factors:

moving distance, velocity, acceleration and moving direction thereof.

12. The terminal of claim 10, wherein the pre-established angular position is specified by an angle at which it is tilted to at least one of axes.

13. The terminal of claim 9, wherein the at least an object includes a top n objects displayed on the output image closer to the center thereof.

14. The terminal of claim 9, wherein the visual search is performed by remote operation equipment communicable therewith.

15. The terminal of claim 9, wherein an output image generating part for providing information on at least one of the objects obtained as a result of performing the visual search is further included.

16. The terminal of claim 15, wherein the output image generating part forms and provides the image inputted thereby overlaid with the information on at least one of object(s) in a form of augmented reality.

19. The terminal of claim 9, wherein the triggering event identifying part determines the input of a key at its first angular position as a first triggering event and the input of another key at its second angular position as a second triggering event;

and

wherein the visual search part performs a retrieval of information around the location of the terminal at the time of the occurrence of the first triggering event and then performs the visual search for said at least an object included on the output image displayed through the terminal at the time of the occurrence of the second triggering event.

20. The terminal of claim 15, wherein the output image generating part senses its movement and/or angular position by using said at least one sensor, determines whether the triggering event has occurred by referring to at least one of the sensed movement and the sensed angular position, and changes at least one of a method of displaying information on objects and an information type, if the triggering event for controlling the output image occurs.