Apparatus and method for selecting item using movement of object

• US 9,256,288 B2
• Filed: 11/17/2011
• Issued: 02/09/2016
• Est. Priority Date: 11/22/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Dong-ho, Ryu, Hee-seob, Park, Seung-kwon, Jeong, Seong-hun, Moon, Jong-bo
• Primary Examiner(s): Ng, Amy
• Assistant Examiner(s): VU, TOAN H
• Application Number:
  US13/298,871
• Publication Number:
  US 20120131518A1
• Time in Patent Office: 1,545 Days
• Field of Search: 715/863, 715/856, 715/700, 715/739, 715/771, 345/156, 345/158, 345/157
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

An item selecting apparatus includes a movement detecting unit detecting a movement of a user, a screen displaying image information, a display image storage unit storing data to generate an image to be displayed on the screen, a display image generating unit generating an image to be displayed on the screen, and a control unit controlling so that a plurality of items is displayed on the screen in one of one-, two- and three-dimensional arrangements, in which the control unit receives a signal from the movement detecting unit to measure a movement of the object in at least one of x-, y- and z-axis directions and issues a command to select at least one from among the plurality of items or provides visual feedback thereto, in response to the measured movement of the user and in accordance with the arrangement of the plurality of items on the screen.

Claims

1. An item selecting apparatus comprising:

a display screen to display a plurality of items;

an image sensor which captures an image of an object;

an object analyzer which analyzes a position and a shape of the object in the image and determines the shape of the object; and

a controller which controls the plurality of items to be displayed on the display screen in one of one-dimensional, two-dimensional, and three-dimensional arrangements,

wherein in response to the analysis of the position and the shape of the object, if a movement of the object is slower than or equal to a predetermined reference speed, the controller controls at least one of the displayed plurality of items, corresponding to the position of the object, to be highlighted,

wherein if the movement of the object is faster than the predetermined reference speed, the controller controls the display screen to display another plurality of items by replacing the displayed plurality of items with the another plurality of items,

wherein if the displayed plurality of items is arranged in the one-dimensional arrangement and the movement of the object is within a predetermined angle with respect to a direction of the one-dimensional arrangement, the controller outputs a command corresponding to a visual feedback with respect to at least one item of the displayed plurality of items,

wherein if the displayed plurality of items is arranged in the one-dimensional arrangement and the movement of the object is not within the predetermined angle, the controller outputs the command corresponding to the selection or the activation of the at least one item, and

wherein if changes in the movement of the object are maintained within a predetermined time from a time of outputting the command corresponding to the visual feedback, the controller outputs the command corresponding to the selection or the activation of the at least one item.

2. The item selecting apparatus of claim 1, wherein if the displayed plurality of items is arranged in the three-dimensional arrangement, the controller outputs a command corresponding to a visual feedback with respect to the at least one item in response to the movement of the object,

wherein if changes in the movement of the object are maintained within a predetermined time from a time of the outputting of the command corresponding to the visual feedback, the controller outputs the command corresponding to the selection or the activation of the at least one item, and

wherein if the movement of the object corresponds to a predetermined specific pattern, the controller outputs the command corresponding to the selection or the activation of the at least one item.

3. The item selecting apparatus of claim 1, wherein it is determined that the shape of the object is changed, the controller outputs a command for the at least one of the displayed plurality of items.

4. The item selecting apparatus of claim 1, wherein the object analyzer further measures the movement of the object in at least one of x-axis, y-axis and z-axis directions.

5. The item selecting apparatus of claim 1, wherein if the movement of the object corresponds to a predetermined pattern, the controller outputs the command corresponding to the selection or activation of the at least one item.

6. The item selecting apparatus of claim 1, wherein if the visual feedback is arranged on an edge of the display screen and if the movement moves toward the edge of the display screen, the controller controls the display screen to display a second plurality of items, and the controller outputs a command corresponding to second visual feedback with respect to at least one of the displayed second plurality of items.

7. The item selecting apparatus of claim 1, wherein if the displayed plurality of items is arranged in the two-dimensional arrangement and the movement of the object is in x-axis and y-axis directions, the controller outputs a command corresponding to a visual feedback with respect to at least one item of the displayed plurality of items, and

wherein if the displayed plurality of items is arranged in the two-dimensional arrangement and the movement of the object is in a z-axis direction, the controller outputs the command corresponding to the selection or the activation of the at least one item.

8. The item selecting apparatus of claim 7, wherein if changes in the movement of the object are maintained within a predetermined time from a time of outputting the command corresponding to the visual feedback, the controller outputs the command corresponding to the selection or the activation of the at least one item.

9. The item selecting apparatus of claim 7, wherein if the movement of the object corresponds to the predetermined specific pattern, the controller outputs the command corresponding to the selection or the activation of the at least one item.

10. The item selecting apparatus of claim 1, wherein when a direction of the movement of the object and a direction of at least one of the displayed plurality of items are at right angle, the controller outputs a command for a selection the at least one of the displayed plurality of items.

11. The item selecting apparatus of claim 1, wherein the controller outputs a visual feedback with respect to at least one of the displayed plurality of items, when outputting the command for selection or activation of at least one of the displayed plurality of items.

12. A method for selecting at least one item from among a plurality of items displayed on a display screen, the method comprising:

displaying a plurality of items on the display screen in one of one-dimensional, two-dimensional, and three-dimensional arrangements;

capturing an image of an object;

analyzing a position and a shape of the object in the image and determining a shape of the object, and

in response the analysis of the position and the shape of the object, if a movement of the object is slower than or equal to a predetermined reference speed, controlling at least one of the displayed plurality of items, corresponding to the position of the object, to be highlighted, and

if a movement of the object is faster than the predetermined reference speed, controlling the display screen to display another plurality of items by replacing the displayed plurality of items with the another plurality of items,

wherein if the displayed plurality of items is arranged in the one-dimensional arrangement and the movement further comprises one of;

providing a visual feedback with respect to at least one item of the displayed plurality of items, if the movement of the object is in a direction that falls within a predetermined angle with respect to a direction of arrangement, and

selecting or activating the at least one item if the movement of the object is in a direction that deviates from the predetermined angle with respect to the direction of arrangement, and

wherein the method further comprises selecting or activating the at least one item if changes in the movement of the object are maintained within a predetermined time for a time of providing the visual feedback.

13. The method of claim 12, further comprising selecting or activating the at least one item if the movement of the object corresponds to a predetermined specific pattern.

14. The method of claim 12, further comprising, if the visual feedback is provided with respect to one of the displayed plurality of items which is arranged on an edge of the display screen and if the movement moves toward the edge of the display screen, displaying another set of plurality of items distinct from the said displayed plurality of items on the display screen, and

providing the visual feedback with respect to at least one of the displayed plurality of items of the another set.

15. The method of claim 12, wherein if the displayed plurality of items is arranged in the two-dimensional arrangement, the method further comprises:

providing a visual feedback with respect to at least one item of the plurality of items, if the movement of the object is in x-axis and y-axis directions; and

selecting or activating the at least one item if the movement of the object is a z-axis direction.

16. The method of claim 15, further comprising selecting or activating at least one item if changes in the movement of the object are maintained within a predetermined time from a time of providing the visual feedback.