Holographic human-machine interfaces

• US 20050002074A1
• Filed: 07/02/2004
• Published: 01/06/2005
• Est. Priority Date: 07/03/2003
• Status: Active Grant

• Current Assignee: HoloTouch, Inc.
• Original Assignee: HoloTouch, Inc.
• Inventors: McPheters, R. Douglas, Perry, John F. W., Breitenbach, John
• Granted Patent: US 7,054,045 B2
• Time in Patent Office: Days
• US Class Current: 359/15
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/0408 Total internal reflection [TIR] holograms, e.g. edge lit or substrate mode holograms
• CPC Class Codes: G03H 1/22 Processes or apparatus for obtaining an optical image from holograms G03H1/26 - G03H1/34 take precedence
• CPC Class Codes: G03H 1/2286 Particular reconstruction light G03H1/24 takes precedence; Beam properties
• CPC Class Codes: G03H 1/26 Processes or apparatus specially adapted to produce multiple sub- holograms or to obtain images from them, e.g. multicolour technique
• CPC Class Codes: G03H 1/265 Angle multiplexing; Multichannel holograms G03H1/268 takes precedence
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G03H 2001/2223 Particular relationship between light source, hologram and observer
• CPC Class Codes: G03H 2001/2226 Edge lit holograms
• CPC Class Codes: G03H 2001/2231 Reflection reconstruction
• CPC Class Codes: G03H 2001/2234 Transmission reconstruction
• CPC Class Codes: G03H 2001/226 Virtual or real
• CPC Class Codes: G03H 2227/02 Handheld portable device, e.g. holographic camera, mobile holographic display
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

A holographic HMI is described by which data and commands can be entered into computers and other electronic equipment. The holographic HMI involves no tangible physical contact between the human operator and the control elements of the HMIs because the input devices are holographic images of keys or other customarily touch-activated tangible input elements. Operator interaction with those holographic images is detected through electromagnetic means or other means, obviating the need for direct physical contact with any solid input object or surface. Such holographic HMIs comprise a hologram for generating a holographic image of a tangible input object of the tangible control mechanism for the electronic or electro-mechanical device. An illumination device illuminates the hologram to produce the holographic image. An actuation detection device detects the selection by the operator of a holographic image, generated by the hologram, of the tangible input object, and a signal generator receives the detection of the actuation detection device and provides an input signal to the electronic or electro-mechanical device thereby to produce the response. The hologram is affixed to a transparent or translucent material.

Claims

1. An apparatus allowing an operator to control an electronic or electro-mechanical device of the type conventionally controlled by a tangible control mechanism having one or more customarily touch-activated tangible input objects, physical contact with which produces a response by the electronic or electro-mechanical device, said apparatus allowing such control without the operator physically touching any solid object and comprising:

hologram means for generating a holographic image of a tangible input object of the tangible control mechanism for the electronic or electro mechanical device;

illumination means for illuminating said hologram means to produce the holographic image;

actuation detection means for detecting selection by the operator of the holographic image, generated by said hologram means, of the tangible input object; and

signal generation means for receiving the detection of said actuation detection means and providing an input signal to the electronic or electro mechanical device thereby to produce the response,

wherein said hologram means is affixed to at least one of a transparent material and a translucent material.

2. An apparatus according to claim 1, wherein said at least one of said transparent material and said translucent material is selected from glass, acrylic, and plastic.

3. An apparatus according to claim 1, wherein the actuation generation means comprises:

emission/detection means for producing and receiving electromagnetic radiation, positioned on a side of said hologram means opposite the operator, wherein said emission/detection means is positioned to transmit and receive electromagnetic radiation toward the holographic image of the tangible input object and through said material to which said hologram means is affixed, and said emission/detection means determines the selection by the operator of the holographic image of the tangible input object through the material.

4. An apparatus according to claim 1, further comprising at least one mirror so as to alter said illumination means light path to position one or more holographic image on an edge of a screen that is employed to present information to the operator.

8. An apparatus as in claim 1, 5, or 6, wherein said hologram means generates a plurality of holographic images, each of one of a plurality of tangible input objects, and wherein said actuation detection means is capable of detecting which of said plurality of holographic images is selected by the operator.

9. An apparatus as in claim 1, 5, or 6, further comprising at least one mirror interposed between said hologram means and said illumination means so as to shorten the physical distance between said hologram means and said illumination means and nevertheless produce the holographic image.

10. An apparatus as in claim 1, 5, or 6, wherein said hologram means includes a lens with convergent properties.

11. An apparatus as in claim 1, 5, or 6, further comprising at least one lens interposed between said hologram means and said illumination means so as to shorten the physical distance between said hologram means and said illumination means and nevertheless produce the holographic image.

12. An apparatus as in claim 1, 5, or 6, wherein said signal generation means also generates at least one of an audible signal and a visible signal to indicate to the operator that the actuation detection means has detected selection of the holographic image by the operator.

13. An apparatus as in claim 1, 5, or 6, wherein said illumination means comprises a reconstructing light source located at the edge of the material to which said hologram means is affixed.

5. An apparatus for allowing an operator to control a plurality of electronic or electro mechanical devices of the type conventionally controlled by a separate tangible control mechanism having a plurality of customarily touch-activated tangible input objects, physical contact with which produces a response by at least one of the electronic or electro mechanical devices, the apparatus allowing such control without the operator physically touching any solid object and comprising:

a hologram unit adapted to generate a plurality of holographic images each of one of the tangible input objects of the tangible control mechanism for the plurality of said electronic or electro mechanical devices;

illumination means for illuminating said hologram unit to produce the plurality of holographic images;

an actuation detector unit adapted to detect selection by the operator of each of the plurality of holographic images of the tangible input devices; and

a signal generator adapted to receive the detection of said actuation detector unit and provide an input signal to the devices thereby producing the response, wherein said actuation detector and said signal generator are configured to independently produce a response by each electronic or electro mechanical device upon detection of selection of each independent one of said holographic images.

6. A control arrangement apparatus for allowing an operator to control an electronic or electro mechanical device of the type conventionally controlled by a tangible control mechanism having a customarily touch-activated tangible input object physical contact with which produces a response by the device, said control arrangement allowing such control without an operator physically touching any solid object and comprising:

a composite hologram for generating a holographic image of a plurality of tangible input objects of the tangible control mechanism for the device, with the generated holographic image for producing a response by the device corresponding to that produced conventionally by the plurality of tangible input objects of the tangible control mechanism, said composite hologram comprising a plurality of holograms positioned side-by-side along one axis such that each of the holographic images produced thereby represents a different portion of the tangible input objects, such that each of the holographic images can be separately viewed from a different angle relative to said one axis;

an actuation detector for detecting selection by the operator of the holographic image of each of the tangible input devices; and

a signal generator for receiving the detection of said actuation detector and providing an input signal to the device thereby to produce the response.

7. A control arrangement apparatus according to claim 6, wherein said composite hologram consists of a plurality of holograms positioned side-by-side along a second axis generally perpendicular to said one axis such that each of the holographic images represents a different portion of the tangible input objects, such that each of the holographic images presented by said composite hologram can be separately viewed from a different angle relative to said second axis.

14. An apparatus allowing an operator to control an electronic or electro-mechanical device of the type conventionally controlled by a tangible mechanism having one or more customarily touch-activated tangible input objects, physical contact with which produces a response by the electronic or electro-mechanical device, said apparatus allowing such control without the operator physically touching any solid object and comprising:

an actuator image generating unit adapted to generate at least one of a plurality of three-dimensional images of the one or more tangible input objects of the tangible control mechanism for the electronic or electro mechanical device;

an actuator detecting unit adapted to determine the selection by the operator of the at least one of the plurality of three-dimensional images, generated by said actuator image generating unit, of the tangible input objects; and

a signal-generating unit adapted to receive the determination of said actuation detection means and to provide an input signal to the electronic or electro mechanical device,

wherein said actuation detecting unit and signal generating unit are adapted to produce a response upon detection of selection of each three-dimensional image, and

wherein said actuator image generating unit is contained in an electronic or electro mechanical device capable of projecting a three-dimensional image within physical proximity of the operator.

15. A method of allowing an operator to control an electronic or electro-mechanical device of the type conventionally controlled by a tangible control mechanism having one or more customarily touch-activated tangible input objects, physical contact with which produces a response by the electronic or electro-mechanical device, said method allowing such control without the operator physically touching any solid object and comprising:

an actuator image generating step of generating at least one of a plurality of three-dimensional images of the one or more tangible input objects of the tangible control mechanism for the electronic or electro mechanical device;

an actuation detecting step of determining the selection by the operator of the at least one of the plurality of three-dimensional images, generated in said actuator image generating step, of the tangible input objects; and

a signal-generating step of receiving the determination from said actuation detection step and providing an input signal to the electronic or electro mechanical device,

wherein said actuation detecting step and signal generating step produce a response upon detection of selection of each three-dimensional image, and

wherein said actuator image generating step is capable of projecting a three-dimensional image within physical proximity of the operator.