MAN MACHINE INTERFACE FOR A 3D DISPLAY SYSTEM

• US 20140033052A1
• Filed: 09/30/2013
• Published: 01/30/2014
• Est. Priority Date: 07/10/2008
• Status: Active Grant

• Current Assignee: Real View Imaging Ltd.
• Original Assignee: Real View Imaging Ltd.
• Inventors: KAUFMAN, Aviad, ROTSCHILD, Carmel
• Granted Patent: US 9,594,347 B2
• Time in Patent Office: Days
• US Class Current: 715/733
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 30/50 the image being built up from image elements distributed over a 3D volume, e.g. voxels
• CPC Class Codes: G02B 30/56 by projecting aerial or floating images
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/0248 Volume holograms
• CPC Class Codes: G03H 1/08 Synthesising holograms, i.e. holograms synthesized from objects or objects from hologramsusing electric digital computers G06F; G06T
• CPC Class Codes: G03H 1/0866 Digital holographic imaging, i.e. synthesizing holobjects from holograms
• CPC Class Codes: G03H 1/2205 using downstream optical component
• CPC Class Codes: G03H 1/2286 Particular reconstruction light G03H1/24 takes precedence; Beam properties
• CPC Class Codes: G03H 1/2294 Addressing the hologram to an active spatial light modulator
• CPC Class Codes: G03H 1/265 Angle multiplexing; Multichannel holograms G03H1/268 takes precedence
• CPC Class Codes: G03H 2001/0038 analogue or digital holobjects
• CPC Class Codes: G03H 2001/0055 in advertising or decorative art
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G03H 2001/0426 Extended parallax, e.g. panoramic or 360deg. holograms
• CPC Class Codes: G03H 2001/2207 Spatial filter, e.g. for suppressing higher diffraction orders
• CPC Class Codes: G03H 2001/221 Element having optical power, e.g. field lens
• CPC Class Codes: G03H 2001/2223 Particular relationship between light source, hologram and observer
• CPC Class Codes: G03H 2001/2231 Reflection reconstruction
• CPC Class Codes: G03H 2001/2236 Details of the viewing window
• CPC Class Codes: G03H 2001/2239 : Enlarging the viewing window
• CPC Class Codes: G03H 2001/2242 : Multiple viewing windows
• CPC Class Codes: G03H 2001/2271 : RGB holobject
• CPC Class Codes: G03H 2001/2284 : Superimposing the holobject with other visual information
• CPC Class Codes: G03H 2001/2292 : Using scanning means
• CPC Class Codes: G03H 2001/2297 : using frame sequential, e.g. for reducing speckle noise
• CPC Class Codes: G03H 2001/262 : not in optical contact G03H1/30 takes precedence
• CPC Class Codes: G03H 2001/2655 : Time multiplexing, i.e. consecutive records wherein the period between records is pertinent per se
• CPC Class Codes: G03H 2001/266 : Wavelength multiplexing
• CPC Class Codes: G03H 2001/303 : Interleaved sub-holograms, e.g. three RGB sub-holograms having interleaved pixels for reconstructing coloured holobject
• CPC Class Codes: G03H 2210/20 : 2D object
• CPC Class Codes: G03H 2210/30 : 3D object
• CPC Class Codes: G03H 2210/32 : 3D+2D, i.e. composition of 3D and 2D sub-objects, e.g. scene in front of planar background
• CPC Class Codes: G03H 2210/36 : Occluded features resolved due to parallax selectivity
• CPC Class Codes: G03H 2222/20 : Coherence of the light source
• CPC Class Codes: G03H 2222/22 : Spatial coherence
• CPC Class Codes: G03H 2222/33 : Pulsed light beam
• CPC Class Codes: G03H 2222/52 : Divergent beam
• CPC Class Codes: G03H 2223/24 : Reflector; Mirror
• CPC Class Codes: G03H 2225/60 : Multiple SLMs
• CPC Class Codes: G03H 2225/61 : for multicolour processing
• CPC Class Codes: G03H 2226/02 : Computing or processing means, e.g. digital signal processor [DSP]
• CPC Class Codes: G03H 2226/04 : Transmission or communication means, e.g. internet protocol
• CPC Class Codes: G03H 2226/05 : Means for tracking the observer
• CPC Class Codes: G03H 2227/02 : Handheld portable device, e.g. holographic camera, mobile holographic display
• CPC Class Codes: G03H 2227/03 : Means for moving one component G03H1/0476, G03H2001/2695 take precedence
• CPC Class Codes: G03H 2240/61 : SLM related parameters, e.g. pixel size
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 : Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 : Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 : with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 : Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: H04N 13/366 : using viewer tracking
• CPC Class Codes: H04N 13/368 : for two or more viewers
• CPC Class Codes: H04N 13/383 : for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/388 : Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume

Abstract

Disclosed are methods and systems for displaying images, and for implementing volumetric user interfaces. One exemplary embodiment provides a system comprising: a light source; an image producing unit, which produces an image upon interaction with light approaching the image producing unit from the light source; an eyepiece; and a mirror, directing light from the image to a surface of the eyepiece, wherein the surface has a shape of a solid of revolution formed by revolving a planar curve at least 180° around an axis of revolution.

Claims

1. A method for implementing a floating-in-the-air user interface, comprising:

displaying a first image in a display space of a first floating-in-the-air display;

inserting a real object into the display space of the first floating-in-the-air display;

locating a location of the real object within the display space of the first floating-in-the-air display; and

providing the location as input to the floating-in-the-air user interface.

2. The method of claim 1 in which said first image is produced by computer generated holography.

3. The method of claim 1 wherein the real object is a finger.

4. The method of claim 1 and further comprising:

displaying an actuator in the first image;

moving the location of the real object to the actuator; and

interpreting the location input as the real object actuating the actuator.

5. The method of claim 1 and further comprising:

moving the location of the real object;

tracking the location of the real object over time;

interpreting the location input as the real object manipulating at least a part of the first image.

6. The method of claim 1, wherein the real object further comprises a plurality of real objects, and using the locations of each of the real objects as location inputs for the floating-in-the-air user interface.

7. The method of claim 1, wherein the location comprises two locations within the display space, and the two locations determine an axis of rotation in display space.

8. The method of claim 1, wherein the location further comprises a plurality of locations based, at least in part, on a plurality of different locations of the point on the real object at different times.

9. The method of claim 8, wherein a path connecting the plurality of locations is displayed by the first floating-in-the-air display.

10. The method of claim 8, and further comprising implementing, based, at least in part, on the plurality of locations, at least one function of the group of functions:

zooming in on the first image;

zooming out of the first image;

cropping the first image;

rotating the first image;

slicing the first image;

measuring a length within the first image;

measuring an area within the first image; and

measuring a volume within the first image.

11. The method of claim 1 wherein the floating-in-the-air user interface is used to implement a Computer Aided Design (CAD) user interface.

12. The method of claim 1 in which said input further comprises at least one additional input selected from a group consisting of:

a voice command;

a mouse click;

a keyboard input; and

a button press.

13. The method of claim 1, and further comprising marking the point so as to substantially contrast with a rest of the real object.

14. The method of claim 1, wherein the location comprises a line defined by a long axis of the real object.

15. The method of claim 1 and further comprising:

a second floating-in-the-air display displaying a second image at substantially the same time as the first floating-in-the-air display displays the first image.

16. The method of claim 15 wherein the first floating-in-the-air display displays an identical display as the second floating-in-the-air display.

17. The method of claim 15 wherein the first floating-in-the-air display and the second floating-in-the-air display are used to implement a remote medicine interaction between a first user of the first floating-in-the-air display and a second user of the second floating-in-the-air display.

18. The method of claim 15 wherein the first floating-in-the-air display and the second floating-in-the-air display are used to implement a whiteboard-like collaborative sharing between the first display and the second display.

19. The method of claim 15 wherein the first floating-in-the-air display and the second floating-in-the-air display are used to implement a game in which a first user of the first floating-in-the-air display and a second user of the second floating-in-the-air display participate.

20. A user interface comprising:

a first floating-in-the-air display; and

a first input unit adapted to accept input from a first location within a first display space, the first display space being a volume within which objects are displayed by the first floating-in-the-air display.

21. The user interface of claim 20, wherein the floating-in-the-air display is a volumetric display.

22. The user interface of claim 20, wherein the floating-in-the-air display is a two-dimensional floating-in-the-air display.

23. The user interface of claim 20, wherein the first floating-in-the-air display is adapted to display the first location.

24. The user interface of claim 20 wherein the first floating-in-the-air display is adapted to display an image within touching reach of a viewer.

25. The user interface of claim 23, further comprising a second floating-in-the-air display, wherein the second floating-in-the-air display displays a scene at least partially identical to a scene displayed by the first floating-in-the-air display, including displaying the first location.

26. The user interface of claim 25 wherein the first floating-in-the-air display and the second floating-in-the-air display, are connected by a communication channel between the first floating-in-the-air display and the second floating-in-the-air display.

27. The user interface of claim 23, further comprising a second floating-in-the-air display, wherein the second floating-in-the-air display displays a scene different from a scene displayed by the first floating-in-the-air display.

28. The user interface of claim 25, and further comprising a second input unit adapted to accept input from a second location within a second display space, the second display space being a volume within which objects displayed by the second floating-in-the-air display appear.

29. The user interface of claim 20, wherein the first floating-in-the-air display is adapted to provide sensory feedback based, at least in part, on the location and on what is being displayed in the location.

30. A method for implementing a three dimensional (3D) user interface, comprising:

locating a first direction for viewing a first 3D scene;

producing a first 3D image of the first 3D scene;

displaying the first 3D image of the first 3D scene to the first direction;

locating a second direction, different from the first direction, for viewing the 3D scene;

producing a second 3D image of the first 3D scene; and

displaying the second 3D image of the first 3D scene to the second direction;

wherein

the second 3D image is produced so the first 3D scene appears from the second direction at same coordinates in space and same direction in space as the first 3D scene appears from the first direction.

31. The method of claim 30 in which:

a viewer views with two eyes;

the first direction comprises a direction of a first eye of the viewer; and

the second direction comprises a direction of a second eye of the viewer,

the displaying the first 3D image comprises displaying the first 3D image to the first eye; and

the displaying the second 3D image comprises displaying the second 3D image to the second eye.

32. The method of claim 30 in which:

the 3D scene is viewed by two viewers;

the first direction comprises a direction of a first viewer; and

the second direction comprises a direction of a second viewer,

the displaying the first 3D image comprises displaying the first 3D image to the first viewer; and

the displaying the second 3D image comprises displaying the second 3D image to the second viewer

wherein

the second 3D image is produced so the first 3D scene appears to the second viewer viewing from the second direction at same coordinates in space and same direction in space as the first 3D scene appears to the first viewer viewing from the first direction.