Audio augmentation of touch detection for surfaces

• US 9,971,457 B2
• Filed: 06/26/2015
• Issued: 05/15/2018
• Est. Priority Date: 06/26/2015
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Hansen, Carl C.
• Primary Examiner(s): ROSARIO, NELSON M
• Application Number:
  US14/752,796
• Publication Number:
  US 20160378219A1
• Time in Patent Office: 1,054 Days
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Embodiments are generally directed to audio augmentation of touch detection for surfaces. An apparatus may include a pedestal, the pedestal including an audio sensor to detect a vibration from a surface on which the apparatus is placed; an arm coupled with the pedestal; and a head element coupled with the arm, wherein the head element includes a visual sensor to detect location of an object in relation to the surface.

Claims

1. A system comprising:

a processor to process data and instructions;

an image projector to project an input image on a physical surface to enable the user input to the system, the physical surface being a non-touch sensitive surface;

a depth camera to detect location of an object in relation to the surface; and

an audio sensor to detect a vibration from the surface, wherein the system is to enable the audio sensor when the object is within a threshold distance from the physical surface and is to disable the audio sensor when the object is outside the threshold distance from the physical surface;

wherein the system is to determine that a touch of the object within the projected input image on the physical surface has occurred upon the processor;

detecting with the depth camera that the object is within the threshold distance from the physical surface and that the object is moving towards the physical surface,

enabling the audio sensor to monitor for vibration in response to detecting that the object is within the threshold distance from the physical surface, and

while the object is within the threshold distance and is moving towards the physical surface, detecting with the audio sensor a vibration from the physical surface.

2. The system of claim 1, wherein the audio sensor is a microphone.

3. The system of claim 1, wherein the audio sensor is in contact with the physical surface.

4. The system of claim 1, wherein the processor detecting a vibration from the physical surface includes the processor performing signal processing of a received vibration.

5. The system of claim 4, wherein the performance of signal processing of a received vibration includes a comparison of the received vibration with a signature for a touch event.

6. The system of claim 1, wherein the object is a finger of a hand of a user.

7. A non-transitory computer-readable storage medium having stored thereon data representing sequences of instructions that, when executed by a processor, cause the processor to perform operations comprising:

projecting an input image on a physical surface to enable user input to the system, the physical surface being a non-touch sensitive surface;

monitoring with a depth camera the physical surface;

detecting with the depth camera a location of an object in relation to the physical surface;

monitoring with an audio sensor for vibration from the physical surface, including enabling the audio sensor upon determining that the object is within a threshold distance from the physical surface and disabling the audio sensor upon determining that the object is outside the threshold distance from the physical surface; and

determining that a touch of the object within the projected input image on the physical surface has occurred upon the following;

detecting with the depth camera that the object is within the threshold distance from the physical surface and that the object is moving towards the physical surface, enabling the audio sensor to monitor for vibration in response to detecting that the object is within the threshold distance from the physical surface, and

while the object is within the threshold distance and is moving towards the surface, detecting with an audio sensor a vibration from the enabling the audio sensor to monitor for vibration in response to the depth camera determining that the object is within the threshold distance from the physical surface; and

surface.

8. The medium of claim 7, wherein detecting a vibration includes performing signal processing of a received vibration.

9. The medium of claim 8, wherein performing signal processing includes comparing the received vibration with a signature for a touch event.

10. The medium of claim 7, wherein projecting the input image on the physical surface includes projecting a graphical user interface (GUI) on the surface.