SYSTEM AND METHOD FOR IMPLEMENTING 3-DIMENSIONAL USER INTERFACE

• US 20130222233A1
• Filed: 12/10/2012
• Published: 08/29/2013
• Est. Priority Date: 02/29/2012
• Status: Active Grant

• Current Assignee: Korea Advanced Institute of Science and Technology
• Original Assignee: Korea Advanced Institute of Science and Technology
• Inventors: Park, Myoung Soo, Park, Jung-Min
• Granted Patent: US 8,963,834 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A system for implementing a 3-dimensional (3D) user interface includes an input device configured to collect position and normal direction information of a plurality of points located on a 3D object, a calculation device configured to process the position and normal direction information collected by the input device, and an output device configured to output a 3D virtual space set by the calculation device. The calculation device processes the position and normal direction information of the plurality of points, sets a plurality of virtual points corresponding to the plurality of points in the virtual space, and forms a 3D selection region including the plurality of virtual points in the virtual space, and the shape of the selection region is changed in correspondence with change in the position and normal direction of the plurality of virtual points according to shape change of the 3D object.

Claims

1. A system for implementing a 3-dimensional (3D) user interface, the system comprising:

an input device configured to collect position and normal direction information of a plurality of points located on a 3D object;

a calculation device configured to process the position and normal direction information collected by the input device; and

an output device configured to output a 3D virtual space set by the calculation device,

wherein the calculation device processes the position and normal direction information of the plurality of points, sets a plurality of virtual points corresponding to the plurality of points in the virtual space, and forms a 3D selection region including the plurality of virtual points in the virtual space, and

wherein the shape of the selection region is changed in correspondence with change in the position and normal direction of the plurality of virtual points according to shape change of the 3D object.

2. The system for implementing a 3D user interface according to claim 1, wherein the selection region is an ellipsoid abutting on the plurality of virtual points.

3. The system for implementing a 3D user interface according to claim 2, wherein the 3D object is a user'"'"'s hand and the plurality of points are points located on an inner surface of the hand.

4. The system for implementing a 3D user interface according to claim 3, wherein:

some of the plurality of points are located on some fingers of the hand and the remaining points are located on the palm of the hand, and

the selection region is formed according to a curved shape of the inner surface of the hand.

5. The system for implementing a 3D user interface according to claim 3, wherein the input device is a motion glove for detecting motion of the hand.

6. The system for implementing a 3D user interface according to claim 1, wherein the input device is a camera for collecting displacement of the plurality of points on the 3D object.

7. The system for implementing a 3D user interface according to claim 1, wherein the selection region is displayed by the output device so as to be visually perceived by the user.

8. The system for implementing a 3D user interface according to claim 2, wherein:

3D graphics are displayed in the virtual space, and

the graphics are selected by adjusting a size of the selection region such that the graphics are located in the selection region or abuts on the selection region.

9. The system for implementing a 3D user interface according to claim 4, wherein:

3D graphics are displayed in the virtual space,

the size of the selection region is adjusted by the user'"'"'s hand'"'"'s opening or cupping, and the graphics are selected by adjusting a size of the selection region such that the graphics are located in the selection region or abuts on the selection region.

10. The system for implementing a 3D user interface according to claim 9, wherein:

the input device further collects position and normal direction information of a finger in which any of the plurality of points is not located,

the selection of the graphics is decided if the finger in which any of the plurality of points is not located moves to satisfy a predetermined gesture in the state of selecting the graphics, and

a command for processing the decided graphics is input.

11. The system for implementing a 3D user interface according to claim 3, wherein the plurality of points is located on both hands of the user.

12. A method of implementing a three-dimensional (3D) user interface, the method comprising:

outputting a 3D virtual space;

collecting position and normal direction information of a plurality of points located on a 3D object;

processing the collected position and normal direction information of the plurality of points and setting a plurality of virtual points corresponding to the plurality of points in the virtual space;

forming a 3D selection region including the plurality of virtual points in the virtual space; and

changing the shape of the selection region in correspondence with change in the position and normal direction of the plurality of virtual points according to shape change of the 3D object.

13. The method of implementing a 3D user interface according to claim 12, wherein the selection region is an ellipsoid abutting on the plurality of virtual points.

14. The method of implementing a 3D user interface according to claim 13, wherein:

the 3D object is a user'"'"'s hand,

some of the plurality of points are located on some fingers of the hand and the remaining points are located on the palm of the hand, and

the selection region is formed according to a curved shape of the inner surface of the hand.

15. The method of implementing a 3D user interface according to claim 14, further comprising:

displaying 3D graphics in the virtual space; and

selecting the graphics by adjusting the size of the selection region such that the graphics are located in the selection region or abuts on the selection region.

16. The method of implementing a 3D user interface according to claim 15, further comprising:

collecting position and normal direction information of a finger in which any of the plurality of points is not located;

determining if the finger in which any of the plurality of points is not located moves to satisfy a predetermined gesture in the state of selecting the graphics;

deciding the selection of the graphics if the finger in which any of the plurality of points is not located satisfies the predetermined gesture; and

inputting a command for processing the decided graphics.