Method and apparatus for user interface of input devices

• US 9,335,890 B2
• Filed: 07/08/2015
• Issued: 05/10/2016
• Est. Priority Date: 10/31/2007
• Status: Expired due to Fees

• Current Assignee: Genedics, LLC
• Original Assignee: Genedics, LLC
• Inventors: Merritt, Edward, Fein, Gene S., Fein, Jackson T.
• Primary Examiner(s): HICKS, CHARLES V
• Application Number:
  US14/794,080
• Publication Number:
  US 20160026360A1
• Time in Patent Office: 307 Days
• US Class Current: 1/1
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/2294 Addressing the hologram to an active spatial light modulator
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09G 2370/02 Networking aspects
• CPC Class Codes: G09G 3/003 to produce spatial visual effects

Abstract

A 3 dimensional (3-D) user interface system employs: one or more 3-D projectors configured to display an image at a first location in 3-D space; one or more sensors configured to sense user interaction with the image and to provide user interaction information; and a processor configured (i) to receive the user interaction information from the one or more sensors; (ii) to correlate the user interaction with the image; and (iii) to provide one or more indications responsive to a correlation of the user interaction with the image, including displaying the image at a second location in 3-D space.

Claims

1. A system for a 3 dimensional (3-D) user interface, the system comprising:

one or more 3-D projectors configured to display an image at a first location in a 3-D coordinate system;

one or more sensors configured based on quadrilateral angle navigation to sense user interaction with the displayed image and to provide user interaction information; and

a digital processor configured;

(i) to receive the user interaction information from the one or more sensors,

(ii) to correlate the user interaction with the image, and

(iii) to provide one or more indications responsive to a correlation of the user interaction with the image, wherein the one or more indications comprise displaying the image at a second location in the 3-D coordinate system,

wherein the displayed image is displayed from one or more points in the 3-D coordinate system that are at least one of configured and preconfigured to correspond to at least one point sensed by the one or more sensors.

2. The system of claim 1, further comprising a communications port coupled to the processor and configured to provide communications interface with a computer system.

3. The system of claim 1, wherein the displayed image is regulated via system settings that include continuously tracking a stylus by the one or more sensors, the tracking within at least one area associated with the 3-D coordinate system.

4. The system of claim 1, wherein the projectors are configured to display the image as a 3-D display, in a static state.

5. The system of claim 1, wherein the displayed image comprises a 3-D image in a static state where the 3-D image is displayed in the first location disappears when the 3-D image is moved by the processor to the second position.

6. The system of claim 1, wherein the displayed image comprises a 3D image in a static state where the 3D image is displayed in the first position forms a trailing continuous motion effect when the 3D image is moved via the processor to the second position.

7. The system of claim 1, wherein the displayed image comprises a 3-D display of a series of images where the duration of time that each image in the series is displayed is regulated by the system.

8. The system of claim 1, wherein the displayed image comprises one or more 3-D images displayed simultaneously.

9. The system of claim 1, wherein the displayed image comprises multiple 3-D images controlled by voice commands where at least one of the multiple 3-D images is controlled by voice commands.

10. The system of claim 1, wherein the displayed image comprises one or more 3-D images controlled by voice commands where at least one of the 3-D images is controlled by system 3-D devices.

11. The system of claim 1, wherein the displayed image comprises 3-D images controlled by voice commands where at least one of multiple 3-D images is controlled by voice commands in tandem with system 3-D devices.

12. The system of claim 1, wherein the displayed image comprises 3-D images displayed from one or more software programs.

13. The system of claim 1, wherein the one or more sensors include at least one of:

a location sensor, a motion sensor, and a light sensor.

14. A system for a 3 dimensional (3-D) user interface, the system comprising:

one or more 3-D projectors configured to display an image at a first location in a 3-D coordinate system; and

a plurality of sensors configured based on quadrilateral angle navigation to sense user interaction with the displayed image, two or more of the plurality of sensors sensing the user interaction including continuous movements, the two or more of the plurality of sensors configured to scan the 3-D coordinate system, and

a digital processor configured;

(i) to receive the user interaction information from the two or more of the plurality of sensors,

(ii) to correlate the user interaction with the image, and

(iii) to provide one or more indications responsive to a correlation of the user interaction with the image, wherein the one or more indications comprise displaying the image at a second location in the 3-D coordinate system.

15. The system of claim 14, wherein the plurality of sensors include at least one of:

a location sensor, a motion sensor, and a light sensor.

16. The system of claim 14, wherein the plurality of sensors includes one or more laser sensors, the one or more laser sensors being configured to geometrically identify a position within the 3-D coordinate system based upon triangulation or quadrilation.

17. The system of claim 14, wherein the plurality of sensors includes one or more light sensors, the one or more light sensors including at least one of:

a photovoltaic sensor, an image sensor and a photo-electric light sensor.

18. A system for a 3 dimensional (3-D) user interface, the system comprising:

one or more 3-D projectors configured to display a moving image at a first location in a 3-D coordinate system; and

one or more sensors configured based on quadrilateral angle navigation to sense user interaction with the displayed moving image and to provide user interaction information; and

a digital processor configured;

(i) to receive the user interaction information from the one or more of sensors,

(ii) to correlate the user interaction with the moving image, and

(iii) to provide one or more indications responsive to a correlation of the user interaction with the moving image, wherein the one or more indications comprise displaying the moving image at a second location in the 3-D coordinate system.

19. The system of claim 18, wherein the one or more 3-D projectors include two or more 3-D projectors that are configured to change the position of display of the moving image at a first location in the 3-D coordinate system, each one of the two or more 3-D projectors being aligned to a fixed space within the 3-D coordinate system.

20. The system of claim 18, wherein the user interaction includes at least one of:

user interaction with a physical apparatus or user interaction based upon a voice of the user.