Three dimensional human-computer interface

• US 9,541,999 B2
• Filed: 11/09/2007
• Issued: 01/10/2017
• Est. Priority Date: 05/22/2000
• Status: Active Grant

• Current Assignee: F Poszat Hu LLC (Intellectual Ventures LLC)
• Original Assignee: F Poszat Hu LLC (Intellectual Ventures LLC)
• Inventors: Anderson, Paul, Ibrahim, Saquib
• Primary Examiner(s): Harris, Dorothy
• Assistant Examiner(s): Shapiro, Leonid
• Application Number:
  US11/938,218
• Publication Number:
  US 20080068376A1
• Time in Patent Office: 3,350 Days
• Field of Search: 345/204, 345156-158, 345/163
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path

Abstract

A system includes a three dimensional display device configured to project computer generated controls and a target image in a three dimensional target volume; and an actuator configured to be worn by an operator. The system further includes one or more sensors configured to sense a movement of the actuator, wherein the controls are configured to be manipulated corresponding with the movement of the actuator within the target volume to alter an appearance of the target image.

Claims

1. A system comprising:

a three dimensional display device configured to project computer generated controls and to project a target image in a three dimensional target volume, wherein the computer generated controls comprise two or more loops that substantially surround the target image, wherein each of the two or more loops corresponds with a dimensional plane of the three dimensional target volume;

an actuator configured to be worn by an operator; and

one or more sensors configured to sense a movement of the actuator, wherein the computer generated controls are configured to be manipulated corresponding with the movement of the actuator within the three dimensional target volume, and wherein a manipulation of one of the two or more loops alters a size of the target image in the corresponding dimensional plane of the three dimensional target volume.

2. The system according to claim 1 wherein the two or more loops are located orthogonally to each other.

3. The system according to claim 1 wherein the actuator is configured to be worn on an operator'"'"'s hand.

4. The system according to claim 1 wherein the computer generated controls are further configured to be manipulated by immersing the actuator into one or more of the computer generated controls and moving the actuator.

5. The system according to claim 1 wherein movement of the actuator generates a haptic feedback response when the actuator contacts one or more of the computer generated controls.

6. The system according to claim 5 wherein the haptic feedback response simulates contact with one or more of the computer generated controls by providing a resistance to further movement of the actuator.

7. The system according to claim 1 wherein an appearance of one or more of the computer generated controls changes substantially simultaneously as the appearance of the target image is altered.

8. The system according to claim 1 wherein the computer generated controls are further configured such that manipulation of any of the two or more loops rotates the target image in the corresponding dimensional plane of the three dimensional target volume.

9. The system according to claim 1 wherein a manipulation of all of the two or more loops alters the size of the target image in three dimensions.

10. A method comprising:

displaying a three dimensional image in a target volume;

displaying a computer generated operator control comprising two or more orthogonal loops, wherein each of the two or more orthogonal loops corresponds with a dimensional plane of the three dimensional image;

detecting movement of an actuator positioned in the target volume, the operator control responsive to a selection of one of the two or more orthogonal loops by the actuator; and

varying a size of the three dimensional image, according to the selection of the one of the two or more orthogonal loops, in the corresponding dimensional plane.

11. The method according to claim 10 further comprising detecting movement of the actuator within the operator control, wherein a manipulation of any of the two or more orthogonal loops responsive to movement of the actuator causes the three dimensional image to rotate in the corresponding dimensional plane.

12. The method according to claim 11 wherein a manipulation of all of the two or more orthogonal loops causes the three dimensional image to rotate in three dimensions.

13. The method according to claim 10 wherein the actuator is configured to be worn on an operator'"'"'s hand.

14. The method according to claim 13 wherein the actuator is configured to detect a change in position of the operator'"'"'s hand from a clenched first to fingers spread out.

15. The method according to claim 10 wherein the two or more orthogonal loops substantially surround the three dimensional image.

16. The method according to claim 10 wherein a manipulation of all of the two or more orthogonal loops causes the size of the three dimensional image to vary in three dimensions.

17. The method according to claim 10 wherein the operator control appears as a first image encased within a second image, and the relative sizes of the first and second images change in response to the movement of the actuator.

18. A human-computer interface comprising:

means for displaying a three dimensional image in a target volume;

means for displaying one or more computer generated operator controls comprising three loops surrounding the three dimensional image, wherein the three loops are located orthogonally to each other, and wherein each of the three loops corresponds with a dimensional plane of the three dimensional image; and

means for detecting movement of an actuator positioned in the target volume, the one or more operator controls responsive to the movement of the actuator, wherein each of the three loops operates to vary a size of the three dimensional image in the corresponding dimensional plane.

19. The human-computer interface according to claim 18 wherein each of the three loops further operates to rotate the three dimensional image in the corresponding dimensional plane.

20. The human-computer interface according to claim 18 wherein the actuator is configured to be worn on an operator'"'"'s hand.

21. The human-computer interface according to claim 20 wherein the movement of the actuator corresponds to simultaneous movement of the operator'"'"'s hand within the target volume.