Computer user interface using a physical manipulatory grammar

• US 6,268,857 B1
• Filed: 08/29/1997
• Issued: 07/31/2001
• Est. Priority Date: 08/29/1997
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Fishkin, Kenneth P., Harrison, Beverly L., Want, Roy
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): BAUTISTA, XIOMARA L
• Application Number:
  US08/920,443
• Time in Patent Office: 1,432 Days
• Field of Search: 345/156-184, 345/326, 345/358
• US Class Current: 715/863
• CPC Class Codes: G06F 1/16 Constructional details or arrangements
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 1/1652 the display being flexible, e.g. mimicking a sheet of paper, or rollable
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer

Abstract

A method for inputting information to a device connected to a deformable piece includes the steps of manipulating the deformable piece to provide a first morpheme input to the device. The first morpheme input normally triggers a first default action by the device, such as controlling a display, modifying a data structure, or communicating with another electronic device. When a user asynchronously manipulates the deformable piece to provide a second morpheme input to the device, the second morpheme input converts the normally triggered first default action to a second action generally not equivalent to the first default action. This mode of interaction allows formation of morphemic sentences to control a graspable device.

Claims

1. A method for inputting information to a handheld information processing device having an integrated buttonless deformable piece, the method comprising the steps of:

manipulating the deformable piece in a first manner to provide a first morpheme input to the device, the first morpheme input triggering a first action; and

asynchronously manipulating the deformable piece in a second manner to provide a second distinct morpheme input to the device, with the second morpheme input converting the triggered first action to a subsequent second action;

wherein the second morpheme input to the device is different than the first morpheme input to the device.

2. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises the step of spatially manipulating the deformable piece.

3. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises spatially translating the device.

4. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises panning the device.

5. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises pushing the device relative to a user.

6. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises pulling the device relative to a user.

7. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises moving the device within a room.

8. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises moving the device between widely separated sites.

9. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises:

shaking the deformable piece to provide a morpheme input to the device.

10. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises:

flicking the deformable piece to provide a morpheme input to the device.

11. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises:

facing the deformable piece to provide a morpheme input to the device.

12. The method of claim 1, wherein manipulating the deformable piece in at least one of the first and second manners comprises:

lifting the deformable piece to provide a morpheme input to the device.

13. A method for inputting information to a handheld information processing device having an integrated buttonless deformable piece, the method comprising:

accepting a first morpheme input to the device and triggering a first action by the device in response to a first user-provided physical manipulation of the deformable piece; and

accepting a second distinct morpheme input to the device and converting the triggered first action to a subsequent second action in response to a second user-provided physical manipulation being independent of and distinct from the first user-provided physical manipulation.

14. The method of claim 13, wherein at least one of the first and second user-provided physical manipulations of the deformable piece comprises a spatial manipulation of the deformable piece.

15. The method of claim 13, wherein at least one of the first and second user-provided physical manipulations of the deformable piece comprises spatially translating the device.

16. The method of claim 13, wherein the accepting of the first morpheme input to the device and triggering the first action by the device comprises:

receiving information representing an orientation of the deformable piece relative to an external environmental object to provide a morpheme input to the device, and

triggering a first default action by the device in response to the orientation information.

17. The method of claim 13, wherein at least one of the first and second user-provided physical manipulations of the deformable piece comprises pushing the device relative away from the user.

18. The method of claim 13, wherein at least one of the first and second user-provided physical manipulations of the deformable piece comprises pulling the device toward the user.