Human-machine interface

• US 8,937,613 B2
• Filed: 11/18/2010
• Issued: 01/20/2015
• Est. Priority Date: 05/01/2000
• Status: Expired due to Fees

• Current Assignee: David J. Tulbert
• Original Assignee: David J. Tulbert
• Inventors: Tulbert, David J.
• Primary Examiner(s): Nguyen, Jimmy H
• Application Number:
  US12/949,604
• Publication Number:
  US 20110214094A1
• Time in Patent Office: 1,524 Days
• Field of Search: 345/173, 345/176, 178/18.09, 178/19.11
• US Class Current: 345/176
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/0423 using sweeping light beams, e.g. using rotating or vibrating mirror
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A human-machine interface includes a panel formed of energy transmissive material having a contact surface on which one or more contacts may simultaneously be made. An energy source directs energy to the panel. The panel transmits energy received from the energy source to the contact surface. At least one parameter of the energy transmitted by the panel is altered at regions where contacts are made with the contact surface. A detector is coupled to the panel and detects the at least one parameter of the energy generally over the area of the contact surface and outputs values corresponding thereto. A processor is in communication with the detector. The processor processes the output values to determine the locations of the contact regions on the contact surface and at least one other attributed associated with each of the contacts.

Claims

1. A human-machine interface, comprising:

a panel formed of energy transmissive material, and having a substantially non-deformable major contact surface and a second major surface substantially parallel with the major contact surface;

an energy source to direct energy to the panel;

wherein the panel is configured to transmit energy received from the energy source to the major contact surface; and

wherein, at one or more contact regions of the major contact surface where an object contacts the major contact surface, the contact of the object with the major contact surface causes one or more alterations of at least one parameter of energy transmitted by the panel, the altered energy being representative of the object;

an image acquisition device to acquire, through the panel and through the second major surface, an image of a region including the one or more contact regions and generally being over the area of the major contact surface and including at least the alterations of the at least one parameter of the energy; and

a processor configured to communicate with the image acquisition device and process the image to determine a location of each contact region at which the object contacts the major contact surface, wherein the determination of the location of each contact region is based on at least the alterations of the at least one parameter of the energy.

2. The human-machine interface of claim 1, further comprising a second energy source, the second energy source being configured to direct energy, to which the panel is transmissive, to a region above the panel, thereby permitting one or more image representations of at least a portion of the object that is proximal to, but spaced from, the major contact surface of the panel to be acquired by the image acquisition device.

3. The human-machine interface of claim 1, wherein the one or more alterations of the at least one parameter of the energy transmitted by the panel are due to a change, caused by the contact of the object with the major contact surface, in a critical angle of internal reflection.

4. The human-machine interface of claim 3, wherein at least one of the alterations of the at least one parameter of energy transmitted by the panel is a change in a propagation direction of the energy caused by a change in the critical angle of internal reflection at the one or more contact regions of the major contact surface where the object contacts the major contact surface.

5. The human-machine interface of claim 1, further including a memory containing instructions, which, when executed by the processor, operate to recognize gestures performed by a user of the interface.

6. The human-machine interface of claim 5, wherein the instructions, when executed by the processor, operate to recognize human gestures used when manipulating real objects with a human hand.

7. The human-machine interface of claim 1, wherein the major contact surface of the panel is overlaid with at least one sheet of material configured to enhance contrast and/or reduce image artifacts caused by contamination on the major contact surface.

8. A human-machine interface comprising:

a panel formed of energy transmissive material and having a substantially non-deformable major contact surface on which one or more object contacts are to be made by an object and a second major surface generally parallel with said major contact surface;

an energy source to direct energy to said panel, said panel being configured to direct energy received from said energy source to said major contact surface, wherein at least one parameter of energy transmitted by said panel is altered at one or more contact regions where the one or more object contacts are made with said major contact surface, the altered energy being representative of the object;

an image acquisition device to acquire, through the panel and through the second major surface, an image of a region including the one or more contact regions and generally being over the area of the major contact surface and including at least alterations of the at least one parameter of the energy; and

a processor in communication with said image acquisition device, said processor configured to process said image to determine a location of each contact region on said major contact surface, wherein the determination of the location of each contact region on said major contact surface is based on at least the alterations of the at least one parameter of the energy.

9. A human-machine interface, comprising:

a panel formed of energy transmissive material, and having a substantially non-deformable major contact surface and a second major surface substantially parallel with the major contact surface;

an energy source to direct energy to the panel,

wherein the panel is configured to transmit energy received from the energy source to the major contact surface, and

wherein, at one or more contact regions of the major contact surface where an object contacts the major contact surface, the contact of the object with the major contact surface causes one or more alterations of at least one parameter of energy transmitted by the panel, the altered energy being representative of the object;

an image acquisition device to acquire, through the panel and through the second major surface, an image of a region including the one or more contact regions and generally being over the area of the major contact surface and including at least the alterations of the at least one parameter of the energy;

a processor configured to communicate with the image acquisition device and process the image to determine a location of each contact region at which the object contacts the major contact surface, wherein the determination of the location of each contact region is based on at least the alterations of the at least one parameter of the energy; and

a second energy source to direct energy to a region above the major contact surface to irradiate at least one non-contact portion of the object above the major contact surface but not in contact with the major contact surface, at which irradiated non-contact portion at least one parameter of the irradiating energy is altered.

10. The human-machine interface of claim 9, further including instructions, executable by the processor, to determine heights of the at least one non-contact portion of the object above the major contact surface by analyzing an intensity of energy applied to and subsequently reflected from the at least one non-contact portion of the object.

11. The human-machine interface of claim 10, wherein the second energy source is disposed on a side of the panel opposite the major contact surface and is configured to direct the energy through the panel to the region above the major contact surface.

12. The human-machine interface of claim 10, further including instructions, executable by the processor, to compute, based on height determination of the at least one non-contact portion of the object, a three-dimensional representation of the at least one non-contact portion of the object irradiated by the second energy source.

13. The human-machine interface of claim 10, wherein the second energy source is disposed above the major contact surface and is configured to direct the energy above the panel to the region above the major contact surface.

14. The human-machine interface of claim 12, wherein the height determination is made using inverse square law.