System and method for distinguishing multimodal commands directed at a machine from ambient human communications

• US 8,464,183 B2
• Filed: 07/23/2010
• Issued: 06/11/2013
• Est. Priority Date: 06/03/2010
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Dey, Prasenjit, Vennelakanti, Ramadevi
• Primary Examiner(s): PHANTANA ANGKOOL, DAVID
• Application Number:
  US12/842,044
• Publication Number:
  US 20110302538A1
• Time in Patent Office: 1,054 Days
• Field of Search: 715/863, 345/158
• US Class Current: 715/863
• CPC Class Codes: G06F 1/3228 Monitoring task completion, e.g. by use of idle timers, stop commands or wait commands
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

A method and system of distinguishing multimodal HCI from ambient human interactions using wake up commands is disclosed. In one embodiment, in a method of distinguishing multimodal HCI from ambient human interactions, a wake up command is detected by a computing system. The computing system is then woken up to receive a valid user command from a user upon detecting the wake up command. A countdown timer is substantially simultaneously turned on upon waking up the computing system to receive valid user commands. The countdown timer is set based on application usage parameters such as semantics of the valid user command and context of an application associated with the valid user command.

Claims

1. A method of distinguishing multimodal human computer interactions (HCI) from ambient human interactions using wake up commands, comprising:

detecting, by a computing system, a wake up command to wake the computing system from a sleep mode to place the computing system in a mode to receive a user command;

waking up the computing system to receive the user command in response to detecting the wake up command;

activating a countdown timer in response to waking up the computing system;

receiving a user command for an application running on the computing system; and

upon receipt of the user command, setting the countdown timer for a duration, wherein the duration is based upon application usage parameters selected from at least one of semantics of the user command and an expected succession for receiving a follow up command for the application after receiving the user command.

2. The method of claim 1, wherein the wake up command includes a user tap on at least one of a touch sensor and an accelerometer.

3. The method of claim 1, wherein detecting the wake up command includes detecting a user gaze on a specific location of a screen of the computing system, the user being at-a-distance from the computing system.

4. The method of claim 3, wherein the countdown timer remains activated as long as the user gaze is detected.

5. The method of claim 1, wherein the wake up command includes a user tap on at least one of a touch sensor and an accelerometer, and a user gaze on a specific location of a screen of the computing system.

6. The method of claim 1, further comprising:

receiving user commands, by the computing system, while the countdown timer is active.

7. The method of claim 6, further comprising:

entering a sleep mode, by the computing system, when the countdown timer is not active;

detecting a subsequent wake up command initiated from the user; and

waking up the computing system upon detecting the subsequent wake up command.

8. The method of claim 1, wherein the follow-up command is another command that is the same as the user command.

9. The method of claim 1, wherein the follow-up command is another command that is different from the user command.

10. A non-transitory computer-readable storage medium to distinguish multimodal human computer interactions (HCI) from ambient human interactions using wake up commands having computer code that, when executed by a computing system, cause the computing system to:

detect a wake up command;

wake up the computing system in response to a detection of the wake up command;

activate a countdown timer in response to the wake up of the computing system;

receive a user command for an application running on the computing system; and

upon receipt of the user command, setting the countdown timer for a duration, wherein the duration is based upon application usage parameters selected from at least one of semantics of the user command and an expected succession for receiving a follow up command for the application after receiving the user command.

11. The non-transitory computer-readable storage medium of claim 10, wherein the code to detect a wake up command includes code to detect a user tap to the computing system.

12. The non-transitory computer-readable storage medium of claim 10, wherein the code to detect a wake up command includes code to detect a user gaze on a specific location of a screen of the computing system, the user being at-a-distance from the computing system.

13. The non-transitory computer-readable storage medium of claim 10, further comprising code to:

receive user commands while the countdown timer is active.

14. The non-transitory computer-readable storage medium of claim 13, further comprising code to:

place the computing system into to a sleep mode when the countdown timer is not active; and

wake up the computing system in response to a detection of a subsequent wake up command from the user, the user being in a close proximity to the computing system.

15. The non-transitory computer-readable storage medium of claim 10, wherein the countdown timer remains activated as long as the user gaze is detected.

16. A system for distinguishing multimodal human computer interactions (HCI) from ambient human interactions using wake up commands, comprising:

a processor;

a wake up command detector; and

a memory coupled to the processor, wherein the memory includes a wake up command module to;

detect a wake up command by the wake up command detector;

wake up a computing system to receive a user command in response to a detection of the wake up command;

activate a countdown timer in response to a wake up of the computing system;

receive a user command for an application running on the computing system; and

upon receipt of the user command, setting the countdown timer for a duration, wherein the duration is based upon application usage parameters selected from at least one of semantics of the user command and an expected succession for receiving a follow up command for the application after receiving the user command.

17. The system of claim 16, wherein the wake up command detector comprises an accelerometer, a touch sensor or a gaze tracking device.