Apparatus and method for detecting and executing positional and gesture commands corresponding to movement of handheld computing device

• US 6,347,290 B1
• Filed: 06/24/1998
• Issued: 02/12/2002
• Est. Priority Date: 06/24/1998
• Status: Expired due to Term

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Compaq Computer Corporation (HP Inc.)
• Inventors: Bartlett, Joel F.
• Primary Examiner(s): ASSOUAD, PATRICK J
• Application Number:
  US09/103,903
• Time in Patent Office: 1,329 Days
• Field of Search: 702/150, 345/145, 345/146, 345/157, 345/158, 345/863, 345/864
• US Class Current: 702/150
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer

Abstract

A method is provided for processing an input command for a handheld computing device, comprising the steps of: measuring movement of the device over an interval of time with a motion sensor mounted to the device to generate a signal; analyzing the signal measured over the interval of time to determine a gesture command that corresponds to the movement of the device; and processing the gesture command to control the device as of an orientation of the device at the beginning of the interval. In addition to gesture commands, position commands can be input. Position commands are processed by measuring of a series of orientations of the device, analyzing the signal to determine a series of position commands that correspond to the series of orientations of the device, and processing the series of position commands to control the device. The method of processing of gesture commands avoids confusion due to inappropriate processing of orientations falsely determined to be position commands.

Claims

1. A method for processing an input command for a handheld computing device, comprising the steps of:

measuring movement of the entire handheld computing device over an interval of time with a motion sensor mounted to the device to generate a signal;

analyzing the signal measured over the interval of time to determine a series of position commands that correspond to a series of orientations of the device;

analyzing the signal measured over the interval of time to determine a gesture command that corresponds to the movement of the entire handheld computing device from a first orientation to a second orientation;

processing the gesture command to control the device as of said first orientation; and

processing the series of position commands to control the device.

2. A method for processing an input command for a handheld computing device, comprising the steps of:

measuring movement of the device over an interval of time with a motion sensor mounted to the device to generate a signal;

analyzing the signal measured over the interval of time to determine a series of position commands that correspond to a series of orientations of the entire handheld computing device;

analyzing the signal measured over the interval of time to determine a gesture command that corresponds to the movement of the device from a first orientation to a second orientation;

processing the gesture command to control the device as of said first orientation;

processing a series of position commands to control the device; and

ensuring a gesture command is not treated as a position command by returning the device to a state corresponding to said first orientation before proceeding to a state following the state corresponding to said second orientation, so as to avoid erroneous interpretation of any portion of the signal corresponding to a gesture command as a position command.

3. A method for processing an input command for a handheld computing device, comprising the steps of:

measuring movement of the entire handheld computing device over an interval of time with a motion sensor mounted to the device to generate a signal;

analyzing the signal measured over the interval of time to determine a series of position commands that correspond to a series of orientations of the device;

analyzing the signal measured over the interval of time to determine a gesture command that corresponds to the movement of the device from a first orientation to a second orientation;

wherein the determined gesture command is one of a predefined set of gesture commands;

when the signal measured over the interval of time is determined not to be any of the predefined set of gesture commands, processing the series of position commands to control the device; and

when the signal measured over the interval of time is determined to be one of the predefined set of gesture commands, preventing execution of the position commands and processing the gesture command to control the device as of said first orientation.

4. A handheld computing device, comprising:

an enclosure;

a motion sensor system, coupled with said enclosure, configured to detect the angular orientation of the entire handheld computing device; and

a memory containing;

a database of gesture commands;

a procedure for analyzing the signal measured over the interval of time to determine a series of position commands that correspond to a series of orientations of the device;

a procedure for analyzing the signal measured over the interval of time to determine a gesture command that corresponds to the movement of the entire handheld computing device from a first orientation to a second orientation;

wherein the determined gesture command is one of a predefined set of gesture commands stored in the database of gesture commands;

a procedure for processing the gesture command to control the device; and

a procedure for processing the series of position commands to control the device.

8. The handheld computing device of claim 4, wherein said set of gesture commands includes the gesture commands:

zoom in to observe a selected image in detail; and

zoom out to observe a greater portion of a selected image.

9. The handheld computing device of claim 4, wherein said set of gesture commands includes a gesture command activated by rotational movement of the entire handheld computing device.

10. The handheld computing device of claim 4, wherein said set of gesture commands includes a gesture command activated by translational movement of the entire handheld computing device.

22. The handheld computing device of claim 4, wherein the procedure for analyzing the signal measured over the interval of time to determine a gesture command is configured to determine a gesture command that corresponds to a pattern of movement of the device from the first orientation to the second orientation.

5. A handheld computing device, comprising:

an enclosure;

a motion sensor system, coupled with said enclosure, configured to detect the angular orientation of the device; and

a memory containing;

a database of gesture commands;

a procedure for analyzing the signal measured over the interval of time to determine a series of position commands that correspond to a series of orientations of the device;

a procedure for analyzing the signal measured over the interval of time to determine a gesture command that corresponds to the movement of the device from a first orientation to a second orientation;

wherein the determined gesture command is one of a predefined set of gesture commands stored in the database of gesture commands;

a procedure for processing the gesture command to control the device; and

a procedure for processing the series of position commands to control the device;

wherein configured to be mounted on a superior dorsal aspect of a hand to allow wrist and forearm rotational movement about three orthogonal axes.

6. The handheld computing device of claim 5, wherein the enclosure has an approximately triangular shape with rounded vertices to conform to the superior dorsal aspect of the hand.

7. The handheld computing device of claim 5, wherein the enclosure has an underside conforming to the surface of the superior dorsal aspect portion of the hand.

11. The memory of claim 5, further containing:

a procedure for storing a state value corresponding to each of the series of position commands; and

a procedure for restoring the device to the state value corresponding to the last position command before the determined gesture command.

12. A handheld computing device, comprising:

an enclosure;

a motion sensor coupled with the enclosure to generate a signal after measuring movement of the entire handheld computing device over an interval of time;

a memory containing;

a predefined set of gesture commands;

a procedure for analyzing the signal measured over the interval of time to determine a series of position commands that correspond to a series of orientations of the device;

a procedure for analyzing the signal measured over the interval of time to determine a gesture command that corresponds to the movement of the device from a first orientation to a second orientation;

wherein the determined gesture command is one of the predefined set of gesture commands;

a procedure for processing the series of position commands to control the device when the signal measured over the interval of time is determined not to be any of the predefined set of gesture commands; and

a procedure for preventing execution of the position commands and processing the gesture command to control the device as of said first orientation when the signal measured over the interval of time is determined to be one of the predefined set of gesture commands.

16. The handheld computing device of claim 12, wherein said set of gesture commands includes the gesture commands:

zoom in to observe a selected image in detail; and

zoom out to observe a greater portion of a selected image.

17. The handheld computing device of claim 12, wherein said set of gesture commands includes a gesture command activated by rotational movement of the entire handheld computing device.

18. The handheld computing device of claim 12, wherein said set of gesture commands includes a gesture command activated by translational movement of the entire handheld computing device.

23. The handheld computing device of claim 12, wherein the procedure for analyzing the signal measured over the interval of time to determine a gesture command is configured to determine a gesture command that corresponds to a pattern of movement of the device from the first orientation to the second orientation.

13. A handheld computing device, comprising:

an enclosure;

a motion sensor coupled with the enclosure to generate a signal after measuring movement of the device over an interval of time;

a memory containing;

a predefined set of gesture commands;

a procedure for analyzing the signal measured over the interval of time to determine a series of position commands that correspond to a series of orientations of the device;

a procedure for analyzing the signal measured over the interval of time to determine a gesture command that corresponds to the movement of the device from a first orientation to a second orientation;

wherein the determined gesture command is one of the predefined set of gesture commands;

a procedure for processing the series of position commands to control the device when the signal measured over the interval of time is determined not to be any of the predefined set of gesture commands; and

a procedure for preventing execution of the position commands and processing the gesture command to control the device as of said first orientation when the signal measured over the interval of time is determined to be one of the predefined set of gesture commands; and

a configuration that allows the handheld device to be mounted on a superior dorsal aspect of a hand to allow wrist and forearm rotational movement about three orthogonal axes.

14. The handheld computing device of claim 13, wherein the enclosure has an approximately triangular shape with rounded vertices to conform to the superior dorsal aspect of the hand.

15. The handheld computing device of claim 13, wherein the enclosure has an underside conforming to the surface of the superior dorsal aspect portion of the hand.

19. The memory of claim 13, further containing:

a procedure for storing a state value corresponding to each of the series of position commands; and

a procedure for restoring the device to the state value corresponding to the last position command before the determined gesture command.

20. A computer program product for use in conjunction with a handheld computing device, the computing device including a motion sensor to generate a signal after measuring movement of the entire handheld computing device over an interval of time, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising:

a first signal analyzing module for analyzing the signal measured over the interval of time to determine a series of position commands that correspond to a series of orientations of the device;

a second signal analyzing module for analyzing the signal measured over the interval of time to determine whether a portion of the signal that corresponds to the movement of the entire handheld computing device from a first orientation to a second orientation matches one of a predefined set of gesture command signal formats;

a position command processing module for processing the series of position commands to control the device when the signal measured over the interval of time is determined not to be any of the predefined set of gesture commands; and

a state data recall procedure for preventing execution of the position commands and processing the gesture command to control the device as of said first orientation when the signal measured over the interval of time is determined to be one of the predefined set of gesture commands.

21. The computer program product of claim 20, wherein the second signal analyzing module is configured to determine whether a portion of the signal that corresponds to a pattern of movement of the entire handheld computing device from the first orientation to a second orientation matches one of a predefined set of gesture command signal formats.