Graspable device manipulation for controlling a computer display

• US 6,243,075 B1
• Filed: 08/29/1997
• Issued: 06/05/2001
• Est. Priority Date: 08/29/1997
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Fishkin, Kenneth P., Harrison, Beverly L., Mochon, Carlos, Want, Roy
• Primary Examiner(s): Saras, Steven
• Assistant Examiner(s): Mengisteab, Tewolde
• Application Number:
  US08/921,274
• Time in Patent Office: 1,376 Days
• Field of Search: 345/156, 345/173, 345/174, 345/157
• US Class Current: 345/156
• CPC Class Codes: G06F 1/16 Constructional details or arrangements
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 1/1652 the display being flexible, e.g. mimicking a sheet of paper, or rollable
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer

Abstract

A device supporting a manipulatable user interface includes a feedback module for presenting information related to a data structure, along with a processor for controlling the feedback module and the data structure. The feedback module can include non-visual tactile displays, auditory displays, or visual displays. A wide range of manipulatory actions, including morphemes such as folds, tears, twists, bends and various spatial or environmental transformations can be applied to a connected deformable piece. Since the deformable piece contacts at least one sensor that monitors positional changes within multiple subregions of the deformable piece, various commands can be given to the device through manipulation of the deformable piece.

Claims

1. A device supporting a manipulatable user interface, the device comprising:

a feedback module for presenting information related to a data structure;

a processor for controlling the feedback module and the data structure; and

a pliable piece including multiple subregions, the pliable piece physically coupled to the feedback module, with the pliable piece contacting at least one sensor that monitors positional changes within multiple subregions of the pliable piece, positional changes forming at least one senseme, distinguishable sensemes forming at least one morpheme, the at least one sensor being connected to the processor.

2. The device supporting a manipulatable user interface of claim 1, wherein the multiple subregions of the deformable piece further comprise a first subregion having a first pressure sensor and a second subregion having a second pressure sensor.

3. The device supporting a manipulatable user interface of claim 1, wherein deforming the deformable piece causes the processor to modify data structures related to information presented by the feedback module.

4. The device supporting a manipulatable user interface of claim 1, wherein the device further comprises a hand holdable casing sized to be user portable, and wherein the deformable piece covers at least an edge of the hand holdable casing.

5. The device supporting a manipulatable user interface of claim 1, wherein the feedback module comprises a non-visual display.

6. The device supporting a manipulatable user interface of claim 1, wherein the feedback module further comprises a tactile display for presenting touch transmittable information to a user.

7. The device supporting a manipulatable user interface of claim 1, wherein the feedback module further comprises an audio display for presenting hearing transmittable information to a user.

8. The device supporting a manipulatable user interface of claim 1, wherein the display further comprises a visual display for presenting vision transmittable information to a user.

9. The device supporting a manipulatable user interface of claim 1, wherein the device further comprises a casing sized to be user portable, with the feedback module further comprising a visual display for presenting vision transmittable information to a user, the visual display further being sized to present at least a page sized visual display surface of about 8 inches by about 11 inches, and wherein the deformable piece covers at least one edge of the casing.

10. The device supporting a manipulatable user interface of claim 1, wherein the at least one sensor connected to the processor to monitor relative position of its multiple subregions is a pressure sensor.

11. The device supporting a manipulatable user interface of claim 1, wherein the processor is further connected to a light sensor, permitting modification of the data structure based on detected light variations.

12. The device supporting a manipulatable user interface of claim 1, wherein the processor is further connected to a thermal sensor, permitting modification of the data structure based on detected temperature.

13. The device supporting a manipulatable user interface of claim 1, wherein the processor is further connected to an electromagnetic sensor, permitting modification of the data structure based on detected electromagnetic variations.

14. The device supporting a manipulatable user interface of claim 1, wherein the processor is further connected to a vibration sensor, permitting modification of the data structure based on detected vibrations.

15. The device supporting a manipulatable user interface of claim 1, wherein the processor is further connected to an acoustic sensor, permitting modification of the data structure based on detected acoustic information.

16. The device supporting a manipulatable user interface of claim 1, wherein the processor is further connected to a position sensor, permitting modification of the data structure based on detected positional information.

17. The device supporting a manipulatable user interface of claim 1, wherein the processor is further connected to a translational position sensor, permitting modification of the data structure based on detected translational changes in position.

18. The device supporting a manipulatable user interface of claim 1, wherein the processor is further connected to a rotational position sensor, permitting modification of the data structure based on detected rotational changes in position.

19. The device supporting a manipulatable user interface of claim 1, wherein the processor is further connected to a communication module permitting communication with other electronic devices.

20. A device supporting a manipulatable user interface, the device comprising:

a feedback module for presenting information related to a data structure;

a processor for controlling the feedback module and the data structure; and

a pliable piece including multiple subregions, the pliable piece physically coupled to the feedback module, with the pliable piece contacting a sensor mesh that monitors positional changes within multiple subregions of the pliable piece, positional changes forming at least one senseme, distinguishable sensemes forming at lease one morpheme, the sensor mesh being connected to the processor.

21. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a depress action by a user.

22. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a squeeze action by a user.

23. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a fold action by a user.

24. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a curl action by a user.

25. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a stretch action by a user.

26. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a pinch action by a user.

27. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a dogear action by a user.

28. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a twist action by a user.

29. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a relief-map action by a user.

30. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a rip action by a user.

31. The device of claim 20, wherein the sensor mesh in contact with the deformable piece can detect a perforate action by a user.

32. The device of claim 20, wherein the deformable piece is modeled to mimic another object.