Haptic feedback assisted text manipulation

• US 10,503,255 B2
• Filed: 12/02/2010
• Issued: 12/10/2019
• Est. Priority Date: 12/02/2010
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Ramstein, Christophe, Birnbaum, David
• Primary Examiner(s): Edouard, Patrick N
• Assistant Examiner(s): Wilson, Douglas M
• Application Number:
  US12/958,705
• Publication Number:
  US 20120139844A1
• Time in Patent Office: 3,295 Days
• Field of Search: 345173, 715701, 715702, 3404072
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

A system with a touchscreen generates haptic effects in response to a manipulation of text displayed on the touchscreen. The system senses a touch within the text, and determines if the touch is a manipulation of the text, and determines the type of the manipulation. The system then generates a type of haptic event that is based at least in part on the type of the manipulation that was determined.

Claims

1. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to provide haptic feedback on a device comprising a touchscreen, the haptic feedback comprising:

displaying dynamically generated text comprising a plurality of characters comprising graphical objects;

sensing a touch by a user'"'"'s finger within the dynamically generated text;

determining if the touch is a manipulation of the dynamically generated text and determining a type of the manipulation, wherein the manipulation of the dynamically generated text comprises performing a task on the dynamically generated text using the touch, wherein the task comprises sliding the finger across the dynamically generated text and moving at least one of the characters within the dynamically generated text via the sliding; and

while the finger is being slid across the dynamically generated text and is performing the task, generating a type of haptic event based at least in part on the type of the manipulation, wherein the haptic event generates the haptic feedback that is applied to the finger during the sliding;

wherein each type of manipulation includes the moving of at least one of the characters, and a first type of manipulation comprises moving a word within the dynamically generated text, and a second type of manipulation comprises moving a graphical object, and

wherein the type of haptic event is one of a plurality of different types of haptic events each being associated with a corresponding one of the different types of manipulation.

2. The non-transitory computer readable medium of claim 1, wherein the manipulation comprises a selection of the dynamically generated text.

3. The non-transitory computer readable medium of claim 1, wherein a third type of manipulation comprises moving a cursor within the dynamically generated text.

4. The non-transitory computer readable medium of claim 1, wherein the manipulation comprises copying, moving, and pasting the dynamically generated text.

5. The non-transitory computer readable medium of claim 2, wherein the selection of the dynamically generated text comprises one of selecting one of the characters, a word, a sentence, or a paragraph, and a first haptic event is generated for each of the characters, the word, the sentence, and the paragraph.

6. The non-transitory computer readable medium of claim 1, wherein types of haptic events are generated by varying one or more of an amplitude, a time duration, or a frequency of a vibration.

7. The non-transitory computer readable medium of claim 1, further comprising:

determining a portion of the dynamically generated text that is blocked by the touch; and

generating and displaying a magnification window that includes the portion of the dynamically generated text.

8. The non-transitory computer readable medium of claim 1, wherein the type of haptic event is based at least on a speed of the sliding.

9. The non-transitory computer readable medium of claim 8, wherein if the speed is a first amount, a first type of haptic event provides an individual character feeling, and if the speed is a second amount greater than the first amount, a second type of haptic event provides an individual word feeling.

10. The non-transitory computer readable medium of claim 1,

wherein determining the type of the manipulation comprises determining if a point of interest of the dynamically generated text is touched, and

wherein the point of interest comprises at least one of a name of a contact, a telephone number, and or an address.

11. The non-transitory computer readable medium of claim 2, wherein the type of haptic event is based at least on an availability of operations for the selected dynamically generated text.

12. The non-transitory computer readable medium of claim 11, wherein the availability of operations comprises at least one of cut, copy, paste or insert.

13. The non-transitory computer readable medium of claim 12, wherein the haptic event generated in response to the availability of the paste comprises a strength based on a volume of selected dynamically generated text.

27. The computer readable medium of claim 1, wherein determining the type of the manipulation comprises determining if the dynamically generated text comprises a semantic annotation.

28. The computer readable medium of claim 1, further comprising:

sensing a second touch within an image having a background and a foreground, wherein the touch traverses the foreground to the background;

generating a haptic event when the second touch moves to the background.

29. The computer readable medium of claim 2, wherein the selection of the dynamically generated text comprises selecting an item comprising a word, sentence or paragraph, and the haptic event is generated when the touch reaches an end of the item.

30. The computer readable medium of claim 1, wherein types of haptic events are generated by at least one of a vibration, a local deformation of a surface, or a change of friction.

14. A computer implemented method for providing haptic feedback on a device comprising a touchscreen, the method implemented by a processor and comprising:

displaying dynamically generated text comprising a plurality of characters comprising graphical objects;

sensing by the processor a touch by a user'"'"'s finger within the dynamically generated text;

determining by the processor if the touch is a manipulation of the dynamically generated text and determining a type of the manipulation, wherein the manipulation of the dynamically generated text comprises performing a task on the dynamically generated text using the touch, wherein the task comprises sliding the finger across the dynamically generated text and moving at least one of the characters within the dynamically generated text via the sliding; and

while the finger is being slid across the dynamically generated text and is performing the task, generating by the processor a type of haptic event based at least in part on the type of the manipulation, wherein the haptic event generates the haptic feedback that is applied to the finger during the sliding;

wherein each type of manipulation includes the moving of at least one of the characters, and a first type of manipulation comprises moving a word within the dynamically generated text, and a second type of manipulation comprises moving a graphical object, and

wherein the type of haptic event is one of a plurality of different types of haptic events each being associated with a corresponding one of the different types of manipulation.

15. The method of claim 14, wherein the manipulation comprises a selection of the dynamically generated text.

16. The method of claim 14, wherein a third type of manipulation comprises moving a cursor within the dynamically generated text.

17. The method of claim 14, wherein the manipulation comprises copying, moving, and pasting the dynamically generated text.

18. The method of claim 15, wherein the selection of the dynamically generated text comprises one of selecting one of the characters, a word, a sentence, or a paragraph, and a different type of haptic event is generated for each of the characters, the word, the sentence, and the paragraph.

19. The method of claim 14, wherein different types of haptic events are generated by varying one or more of an amplitude, a time duration, or a frequency of a vibration.

20. The method of claim 14, further comprising:

determining a portion of the dynamically generated text that is blocked by the touch; and

generating and displaying a magnification window that includes the portion of the dynamically generated text.

21. The method of claim 14, wherein the type of haptic event is based at least on a speed of the sliding.

22. An apparatus comprising:

a processor;

a non-transitory memory coupled to the processor and storing instructions;

a touchscreen coupled to the processor;

an actuator coupled to the processor;

wherein the instructions, when executed by the processor, cause the apparatus to;

dynamically generate text from a word processing application executed by the processor;

display the dynamically generated text comprising a plurality of characters comprising graphical objects;

sense a touch by a user'"'"'s finger within the dynamically generated text;

determine if the touch is a manipulation of the dynamically generated text and determining a type of the manipulation, wherein determining the type of the manipulation comprises determining if a point of interest of the dynamically generated text is touched, and wherein the manipulation of the dynamically generated text comprises performing a task on the dynamically generated text using the touch, wherein the task comprises sliding the finger across the dynamically generated text and moving at least one of the characters within the dynamically generated text via the sliding; and

while the finger is being slid across the dynamically generated text and is performing the task, generate a type of haptic event with the actuator based at least in part on the type of the manipulation, wherein the haptic event generates a haptic feedback that is applied to the finger during the sliding;

wherein each type of manipulation includes the moving of at least one of the characters, and a first type of manipulation comprises moving a word within the dynamically generated text, and a second type of manipulation comprises moving a graphical object, and

wherein the type of haptic event is one of a plurality of different types of haptic events each being associated with a corresponding one of the different types of manipulation.

23. The apparatus of claim 22, wherein the manipulation comprises a selection of the dynamically generated text.

24. The apparatus of claim 22, wherein a third type of manipulation comprises moving a cursor within the dynamically generated text.

25. The apparatus of claim 22, wherein the manipulation comprises copying, moving, and pasting the dynamically generated text.

26. The apparatus of claim 23, wherein the selection of the dynamically generated text comprises one of selecting one of the characters, a word, a sentence, or a paragraph, and a different type of haptic event is generated for each of the characters, the word, the sentence, and the paragraph.