Power consumption in motion-capture systems with audio and optical signals

• US 9,626,015 B2
• Filed: 01/07/2014
• Issued: 04/18/2017
• Est. Priority Date: 01/08/2013
• Status: Active Grant

• Current Assignee: Lmi Liquidating Co., LLC
• Original Assignee: Leap Motion Incorporated (Ultraleap Limited)
• Inventors: Holz, David
• Primary Examiner(s): Dagnew, Mekonnen
• Application Number:
  US14/149,676
• Publication Number:
  US 20140192259A1
• Time in Patent Office: 1,197 Days
• Field of Search: 348372, 3482314
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/043 using propagating acoustic waves

Abstract

The technology disclosed provides systems and methods for reducing the overall power consumption of an optical motion-capture system without compromising the quality of motion capture and tracking. In implementations, this is accomplished by operating the motion-detecting cameras and associated image-processing hardware in a low-power mode (e.g., at a low frame rate or in a standby or sleep mode) unless and until touch gestures of an object such as a tap, sequence of taps, or swiping motions are performed with a surface proximate to the cameras. A contact microphone or other appropriate sensor is used for detecting audio signals or other vibrations generated by contact of the object with the surface.

Claims

1. A method of operating an optical motion-capture system with reduced power consumption, the method including:

monitoring a contact microphone coupled to an optical motion-capture system, wherein the contact microphone is in contact with a surface of an object upon which one or more cameras of the optical motion-capture system are placed;

detecting an audio signal generated by contact of a control object with the object surface; and

switching at least one camera of the optical motion-capture system, in response to the detected audio signal, from a standby mode to an operational mode;

wherein the standby mode and the operational mode apply to recognition of in-air control object gestures by the optical motion-capture system.

2. The method of claim 1, wherein the contact is a touch, tap, sequence of taps, or swiping motion of the object.

3. The method of claim 1, wherein the microphone is a piezo or electromagnetic actuator.

4. The method of claim 1, wherein the optical motion-capture system includes an ultra-low-power circuit responsive to low-voltage audio signals.

5. The method of claim 1, further including switching the camera from the operational mode to the standby mode in response to further detection of an audio signal generated by subsequent contact of the control object with the surface.

6. The method of claim 1, further including filtering the audio signals to exclude frequencies outside a defined range.

7. The method of claim 1, wherein the contact microphone detects audio signals through the solid object, further including:

in response to detection of an audio signal generated by contact of the control object with another object in contact with the solid object, switching the camera of the optical motion-capture system from the standby mode to the operational mode.

8. The method of claim 1, further including the contact microphone detecting audio signals through the solid object via an intermediate object.

9. The method of claim 1, further including:

monitoring a contact microphone coupled to an optical motion-capture system, wherein the contact microphone detects audio signals propagated through a solid object; and

in response to detection of an audio signal propagated through the solid object by a control object, switching the optical motion-capture system from a standby mode to an operational mode.

10. The method of claim 1, further including:

monitoring a contact microphone coupled to an optical motion-capture system, wherein the contact microphone detects audio signals propagated through a solid object; and

in response to detection of an audio signal propagated through the solid object by a control object, switching a light source of the optical motion-capture system from a standby mode to an operational mode.

11. The method of claim 1, further including:

analyzing camera images for presence of hands in standby mode.

12. The method of claim 11, further including:

analyzing camera images to determine gestures from tracked motions of hands in operational mode.

13. An optical motion-capture system, including:

a camera for capturing images of an object within a field of view thereof;

a contact microphone coupled to the camera and in contact with a surface of an object upon which one or more cameras of the optical motion-capture system are placed;

a sensor for monitoring the contact microphone; and

a control module for switching the camera from a standby mode to an operational mode in response to detection of an audio signal generated by contact of a control object with the object surface;

wherein the standby mode and the operational mode apply to recognition of in-air control object gestures by the optical motion-capture system.

14. The system of claim 13, wherein the contact is a touch, tap, sequence of taps, or swiping motions of the object.

15. The system of claim 13, wherein the microphone is a piezo or electromagnetic actuator.

16. The system of claim 13, wherein the optical motion-capture system includes an ultra-low-power circuit responsive to low-voltage audio signals.

17. The system of claim 13, further configured to switch the camera from the operational mode to the standby mode in response to further detection of an audio signal generated by subsequent contact of the control object with the surface signifying departure of the control object from a field of view of the camera.

18. The system of claim 13, further configured to filter the audio signals to exclude frequencies outside a defined range.

19. The system of claim 13, further configured to include a contact microphone that detects audio signals through the solid object via an intermediate solid object.

20. The system of claim 13, further configured to:

monitor a contact microphone coupled to an optical motion-capture system, wherein the contact microphone detects audio signals propagated through a solid object; and

in response to detection of an audio signal propagated through the solid object by a control object, switch the optical motion-capture system from a standby mode to an operational mode.

21. The system of claim 13, further configured to:

monitor a contact microphone coupled to an optical motion-capture system, wherein the contact microphone detects audio signals propagated through a solid object; and

in response to detection of an audio signal propagated through the solid object by a control object, switch a light source of the optical motion-capture system from a standby mode to an operational mode.

22. The system of claim 13, further configured to:

analyze camera images for presence of hands in standby mode.

23. The system of claim 22, further configured to:

analyze camera images to determine gestures from tracked motions of hands in operational mode.

24. A non-transitory computer readable medium storing a plurality of instructions for programming one or more processors to operate an optical motion-capture system with reduced power consumption, the instructions, when executed on the processors, implementing actions including:

monitoring a contact microphone coupled to an optical motion-capture system, wherein the contact microphone detects audio signals propagated through a solid object surface upon which one or more cameras of the optical motion-capture system are placed; and

in response to detection of an audio signal propagated through the solid object by a control object, switching a camera of the optical motion-capture system from a standby mode to an operational mode;

wherein the standby mode and the operational mode apply to recognition of in-air control object gestures by the optical motion-capture system.