Systems and Methods For Haptic And Gesture-Driven Paper Simulation

• US 20140281954A1
• Filed: 03/14/2013
• Published: 09/18/2014
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Ullrich, Christopher J., Birnbaum, David M., Bothsa, Marcus Aurelius
• Granted Patent: US 9,547,366 B2
• Time in Patent Office: Days
• US Class Current: 715/702
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 15/0291 for reading, e.g. e-books constructional details of portable computers G06F1/1613
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/04809 Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems and methods for haptic and gesture-driven paper simulation are disclosed. For example, one disclosed method includes the steps of receiving an electronic document; receiving metadata associated with the electronic document, the metadata comprising a characteristic indicating a type of paper; generating and transmitting a display signal configured to cause display of the at least a portion of the document; and generating and transmitting a haptic signal based on the type of paper, the haptic signal configured to cause a haptic output device to generate a haptic effect.

Claims

1. A method comprising:

receiving an electronic document;

receiving metadata associated with the electronic document, the metadata comprising a characteristic indicating a type of paper;

generating and transmitting a display signal configured to cause display of the at least a portion of the document; and

generating and transmitting a haptic signal based on the type of paper, the haptic signal configured to cause a haptic output device to generate a haptic effect.

2. The method of claim 1, further comprising:

receiving contact data based on an interaction with a touch sensitive input device, the contact data associated with the portion of the document;

determining a gesture based on the contact data;

determining a deformation of the portion of the document based on the gesture;

generating and transmitting a second display signal configured to cause display of the portion of the document comprising the deformation; and

generating a transmitting a second haptic signal based on the type of paper and the deformation, the second haptic signal configured to cause a haptic output device to generate a second haptic effect, the second haptic effect configured to indicate the deformation.

3. The method of claim 2, wherein the gesture comprises a page-turn gesture or a multi-page turn gesture, the deformation is based on the gesture and the metadata, and the second haptic effect comprises texture or a change in friction.

4. The method of claim 3, wherein the contact data comprises pressure data, and the change in friction is based on the pressure data.

5. The method of claim 3, further comprising generating and transmitting an audio signal based on the gesture and the metadata.

6. The method of claim 3, wherein the electronic document comprises a plurality of pages, the multi-page turn gesture comprises a scrub gesture, and transmitting the second haptic signal comprises transmitting the second haptic signal for each page of the electronic document accessed by the scrub gesture comprising a deformation.

7. The method of claim 3, wherein determining the gesture is further based on the metadata.

8. The method of claim 2, wherein the gesture comprises a folding gesture, the deformation comprises a folding of the portion of the document, and the second haptic effect comprises a texture or a change in friction.

9. The method of claim 8, wherein the folding deformation is configured to simulate the size and shape of the fold based on the gesture and the metadata.

10. The method of claim 2, wherein the gesture comprises a cut gesture, the deformation comprises a cutting of the portion of the document, and the second haptic effect comprises a vibration.

11. The method of claim 1, wherein the metadata further comprises at least one of a roughness characteristic, a color characteristic, weight characteristic, an age characteristic, a brittleness characteristic, or a compliance characteristic.

12. A computer-readable medium comprising program code to cause a processor to execute a method, the program code comprising:

program code for receiving an electronic document;

program code for receiving metadata associated with the electronic document, the metadata comprising a characteristic indicating a type of paper;

program code for generating and transmitting a display signal configured to cause display of the at least a portion of the document; and

program code for generating and transmitting a haptic signal based on the type of paper, the haptic signal configured to cause a haptic output device to generate a haptic effect.

13. The computer-readable medium of claim 12, further comprising:

program code for receiving contact data based on an interaction with a touch sensitive input device, the contact data associated with the portion of the document;

program code for determining a gesture based on the contact data;

program code for determining a deformation of the portion of the document based on the gesture;

program code for generating and transmitting a second display signal configured to cause display of the portion of the document comprising the deformation; and

program code for generating a transmitting a second haptic signal based on the type of paper and the deformation, the second haptic signal configured to cause a haptic output device to generate a second haptic effect, the second haptic effect configured to indicate the deformation.

14. The computer-readable medium of claim 13, wherein the gesture comprises a page-turn gesture or a multi-page turn gesture, the deformation is based on the gesture and the metadata, and the second haptic effect comprises texture or a change in friction.

15. The computer-readable medium of claim 14, wherein the contact data comprises pressure data, and the change in friction is based on the pressure data.

16. The computer-readable medium of claim 14, further comprising program code for generating and transmitting an audio signal based on the gesture and the metadata.

17. The computer-readable medium of claim 14, wherein the electronic document comprises a plurality of pages, the multi-page turn gesture comprises a scrub gesture, and the program code for transmitting the second haptic signal comprises program code for transmitting the second haptic signal for each page of the electronic document accessed by the scrub gesture comprising a deformation.

18. The computer-readable medium of claim 14, wherein the program code for determining the gesture is further based on the metadata.

19. The computer-readable medium of claim 13, wherein the gesture comprises a folding gesture, the deformation comprises a folding of the portion of the document, and the second haptic effect comprises a texture or a change in friction.

20. The computer-readable medium of claim 19, wherein the folding deformation is configured to simulate the size and shape of the fold based on the gesture and the metadata.

21. The computer-readable medium of claim 13, wherein the gesture comprises a cut gesture, the deformation comprises a cutting of the portion of the document, and the second haptic effect comprises a vibration.

22. The computer-readable medium of claim 12, wherein the metadata further comprises at least one of a roughness characteristic, a color characteristic, weight characteristic, an age characteristic, a brittleness characteristic, or a compliance characteristic.

23. A system comprising:

a computer-readable medium;

a touch-sensitive input device;

a display; and

a processor in communication with the computer-readable medium, the touch-sensitive input device, and the display, the processor configured to;

receive an electronic document;

receive metadata associated with the electronic document, the metadata comprising a characteristic indicating a type of paper;

generate and transmit a display signal configured to cause display of the at least a portion of the document; and

generate and transmit a haptic signal based on the type of paper, the haptic signal configured to cause a haptic output device to generate a haptic effect.

24. The system of claim 23, wherein the processor is further configured to:

receive contact data based on an interaction with a touch sensitive input device, the contact data associated with the portion of the document;

determine a gesture based on the contact data;

determine a deformation of the portion of the document based on the gesture;

generate and transmitting a second display signal configured to cause display of the portion of the document comprising the deformation; and

generate a transmitting a second haptic signal based on the type of paper and the deformation, the second haptic signal configured to cause a haptic output device to generate a second haptic effect, the second haptic effect configured to indicate the deformation.