INFORMATION INPUT DEVICE AND INFORMATION DISPLAY METHOD

• US 20140298261A1
• Filed: 08/07/2013
• Published: 10/02/2014
• Est. Priority Date: 08/30/2012
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Imoto, Hiroyasu, Takahashi, Tomonari, Yamauchi, Masaki, Kojima, Yoshihiro
• Granted Patent: US 9,798,456 B2
• Time in Patent Office: Days
• US Class Current: 715/810
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

An information input device including: an indicator detection unit (42); a pointer position setting unit (44) which sets a position of a pointer to be displayed on a display screen (52); a storage unit (46) which obtains and stores time-sequenced positional information which indicates the set position; a first passage detection unit (48) which detects that the pointer has passed through a first specific region which is a predetermined region on the display screen, using the time-sequenced positional information; and a direction obtainment unit (50) which obtains a direction in which the pointer has passed through the first specific region if it is detected that the pointer has passed through the first specific region; and a first image modifying unit (62) which modifies a displayed image, depending on the obtained direction.

Claims

1. An information input device for obtaining, from a user, an instruction for an image displayed on a display screen, the information input device comprising:

an indicator detection unit configured to detect at least one of a position and an orientation of an indicator in a three-dimensional space;

a pointer position setting unit configured to set a position on the display screen of a pointer to be displayed on the display screen, in correspondence with the at least one of the position and the orientation of the indicator in the three-dimensional space detected by the indicator detection unit;

a storage unit configured to obtain and store time-sequenced positional information which indicates the position set by the pointer position setting unit;

a first passage detection unit configured to detect that the pointer has passed through a first specific region which is a predetermined region on the display screen, using the time-sequenced positional information stored in the storage unit;

a direction obtainment unit configured to obtain a direction in which the pointer has passed through the first specific region, if the first passage detection unit detects that the pointer has passed through the first specific region; and

a first image modifying unit configured to modify the image displayed on the display screen, depending on the direction obtained by the direction obtainment unit.

2. The information input device according to claim 1,

wherein the first specific region is configured with one or more line segments displayed on the display screen,

the first passage detection unit is configured to detect that the pointer has passed through one of the one or more line segments crosswise, and

the first image modifying unit is configured to scroll the image along the direction obtained by the direction obtainment unit.

3. The information input device according to claim 1,

wherein the first specific region is configured with two line segments displayed on the display screen, disposed in parallel with each other,

the first passage detection unit is configured to detect that the pointer has passed through one of the two line segments crosswise, and

the direction obtainment unit is configured to obtain the direction by determining which one of the two line segments through which the pointer has moved crosswise from a first region between the two line segments.

4. The information input device according to claim 1,

wherein the first specific region is an icon displayed on the display screen, and

if the direction obtained by the direction obtainment unit is a predetermined direction, the first image modifying unit is configured to modify the image in such a manner that the icon is split into two or more partial icons.

5. The information input device according to claim 1, further comprising:

a repetition detecting unit configured to detect that the pointer is in a repetitive motion on the display screen, using the time-sequenced positional information stored in the storage unit;

a repetition detection enabling unit configured to disable the repetition detecting unit for detection, and enable the repetition detecting unit for detection after the first passage detection unit detects that the pointer has passed through the first specific region; and

a second image modifying unit configured to repeatedly modify the image if an effective detection is performed by the repetition detecting unit.

6. The information input device according to claim 5,

wherein the repetitive motion includes at least one of the pointer in a circular motion on the display screen and the pointer moving back and forth on the display screen.

7. The information input device according to claim 5,

wherein the repetition detecting unit is further configured to detect an end of the repetitive motion, and

the repetition detection enabling unit is further configured to disable the repetition detecting unit for detection if the repetition detecting unit detects the end of the repetitive motion.

8. The information input device according to claim 5, further comprising

a second passage detection unit configured to detect that the pointer has passed through a second specific region which is predetermined on the display screen, using the time-sequenced positional information stored in the storage unit,

wherein the repetition detection enabling unit is further configured to disable the repetition detecting unit for detection if the second passage detection unit detects that the pointer has passed through the second specific region.

9. The information input device according to claim 8,

wherein the second passage detection unit is further configured to obtain a direction in which the pointer has passed through the second specific region, and

the repetition detection enabling unit is configured to disable the repetition detecting unit for detection if the second passage detection unit detects that the pointer has passed through the second specific region and the direction obtained by the second passage detection unit is a predetermined direction.

10. The information input device according to claim 9, further comprising

a third image modifying unit configured to modify the second specific region, depending on a degree to which the second image modifying unit modifies the image.

11. The information input device according to claim 10,

wherein modification of the image, which corresponds to the repetitive motion, is scrolling the image and moving the pointer on the display screen, and

the third image modifying unit is configured to display an image indicative of a location of the second specific region by placing the second specific region farther away from the first specific region with increased rates at which the image is scrolled and the pointer is moved.

12. The information input device according to claim 1, further comprising

a direction setting unit configured to set a direction in which the pointer is to pass through the first specific region, in accordance with an attribute of the first specific region,

wherein the first image modifying unit is configured to modify the image if the direction obtained by the direction obtainment unit is the direction set by the direction setting unit.

13. The information input device according to claim 12,

wherein if the first specific region is disposed in contact with a side among sides forming a frame of the display screen, the direction setting unit is configured to set a direction across the side as the direction in which the pointer is to pass through the first specific region.

14. The information input device according to claim 12,

wherein if the first specific region is disposed in contact with a side among sides forming a frame of the display screen, the direction setting unit is configured to set a direction parallel with the side as the direction in which the pointer is to pass through the first specific region.

15. The information input device according to claim 12,

wherein the direction setting unit is configured to set the direction in which the pointer is to pass through the first specific region, in accordance with a density of a plurality of the first specific regions.

16. The information input device according to claim 12, further comprising

a primary operational direction setting unit configured to set a primary operational direction of the user with respect to the image, based on an attribute of the first specific region,

wherein the direction setting unit is configured to set a direction, among directions exclusive of the primary operational direction set by the primary operational direction setting unit, as the direction in which the pointer is to pass through the first specific region.

17. The information input device according to claim 16, further comprising

a display screen state detection unit configured to detect a position and a posture of the display screen relative to the indicator detection unit,

wherein the primary operational direction setting unit is configured to set the primary operational direction, in accordance with the position and the posture detected by the display screen state detection unit.

18. The information input device according to claim 12,

wherein the indicator detection unit is configured to detect a posture of a hand or a finger of the user, and

the direction setting unit is configured to set the direction in which the pointer is to pass through the first specific region, in accordance with the posture detected by the indicator detection unit.

19. An information input method executed by a device for obtaining, from a user, an instruction for an image displayed on a display screen, the information input method comprising:

(a) detecting at least one of a position and an orientation of an indicator in a three-dimensional space;

(b) setting a position on the display screen of a pointer to be displayed on the display screen, in correspondence with the at least one of the position and the orientation detected in step (a);

(c) obtaining and storing time-sequenced positional information which indicates the position set in step (b);

(d) detecting that the pointer has passed through a first specific region which is a predetermined region on the display screen, using the time-sequenced positional information stored in step (c);

(e) obtaining a direction in which the pointer has passed through the first specific region, if it is detected in step (d) that the pointer has passed through the first specific region; and

(f) modifying an image displayed on the display screen, depending on the direction obtained in step (e).

20. A non-transitory computer-readable recording medium storing a program for causing a computer to execute the information input method according to claim 19.

21. An information display method executed by a computer, the information display method comprising:

(a) displaying one or more items on a display screen; and

(b) obtaining an instruction from a user by detecting at least one of a position and an orientation of an indicator in a three-dimensional space,

step (a) having;

a first mode in which at least one item is selected from among the one or more items in accordance with the instruction from the user obtained in step (b); and

a second mode in which a process involving modification of display of the at least one item selected in the first mode is performed,

wherein if the instruction from the user obtained in step (b) is to cause movement from one of two or more regions set on the display screen to any of remaining regions, the first mode is switched to the second mode or the second mode is switched to the first mode.

22. The information display method according to claim 21,

wherein the two or more regions include two regions partitioned by a line segment displayed on the display screen, and

the movement includes a movement across the line segment.

23. The information display method according to claim 21,

wherein a plurality of groups are displayed on the display screen in step (a), the groups each including at least one item, and

in the first mode, a first group of the plurality of groups is selectable and a second group of the plurality of groups is not selectable.

24. The information display method according to claim 23,

wherein in the first mode, if the instruction from the user obtained in step (b) is to cause the movement, an item belonging to the first group turns to belong to the second group, and is made not selectable.

25. The information display method according to claim 21,

wherein in the second mode,

an icon associated with the process on the at least one item selected in the first mode is displayed on the display screen,

the icon is associated with two or more regions, and

the process associated with the icon is performed if the instruction from the user obtained in step (b) is to cause movement from one of the two or more regions associated with the icon to any of remaining regions.

26. The information display method according to claim 25,

wherein the icon assumes a state where the process associated with the icon can be performed and a state where the process associated with the icon cannot be performed, depending on an attribute of the at least one item with which the icon is associated.

27. The information display method according to claim 21,

wherein step (a) further has a third mode in which a menu is displayed,

in step (a),

if pointer movement indicated by the instruction from the user obtained in step (b) belongs to a first pattern, the first mode or the second mode, which is an original mode, is switched to the third mode, and

if the pointer movement indicated by the instruction from the user obtained in step (b) belongs to a second pattern, the third mode is switched to the original mode.

28. The information display method according to claim 27,

wherein the number of the indicators in a three-dimensional space is further detected in step (b), and

the first pattern and the second pattern are user instructions using a different number of the indicators.

29. A non-transitory computer-readable recording medium storing a program for causing a computer to execute the information display method according to claim 21.

30. An information display device comprising a computer and a display screen, the computer executing:

(a) displaying one or more items on the display screen; and

(b) obtaining an instruction from a user by detecting at least one of a position and an orientation of an indicator in a three-dimensional space,

step (a) having;

a first mode in which at least one item is selected from among the one or more items in accordance with the instruction from the user obtained in step (b); and

a second mode in which a process involving modification of display of the at least one item selected in the first mode is performed,

wherein if the instruction from the user obtained in step (b) is to cause movement from one of two or more regions set on the display screen to any of remaining regions, the first mode is switched to the second mode or the second mode is switched to the first mode.