Multiple actuation handheld device

• US 8,749,495 B2
• Filed: 09/24/2008
• Issued: 06/10/2014
• Est. Priority Date: 09/24/2008
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Grant, Danny A., Heubel, Robert
• Primary Examiner(s): PARDO, THUY N
• Application Number:
  US12/237,334
• Publication Number:
  US 20100073304A1
• Time in Patent Office: 2,085 Days
• Field of Search: 345/156, 345/165, 345/173, 345/177, 846/45, 844/85.R
• US Class Current: 345/173
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: G06F 1/3262 Power saving in digitizer or tablet
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers

Abstract

A device includes a housing, a processor that is coupled to the housing, the processor is configured to process a software program stored in a memory. A touch screen is coupled to the housing and configured to display graphical objects, wherein a sensor signal associated with a user'"'"'s interaction with the touch screen is provided to the processor. A first actuator is coupled to the touch screen and positioned within the housing. The first actuator is configured to output a first haptic effect to the touch screen upon receiving a first activating signal from the processor. A second actuator is coupled to the housing and configured to output a second haptic effect to the housing upon receiving a second activating signal from the processor. The first activating signal is associated with a foreground event and the second activating signal is associated with a background event occurring in the software program.

Claims

1. A device comprising:

a housing;

a processor coupled to the housing, the processor configured to process a software program stored in a memory;

a touch screen coupled to the housing, the touch screen configured to display one or more virtual strings of a musical instrument, wherein a sensor signal associated with an interaction with the virtual string on the touch screen is provided to the processor;

at least one actuator, one of the at least one actuators coupled to the touch screen and positioned within the housing, the one of the at least one actuators configured to output a first haptic effect to the touch screen, the first haptic effect based upon the interaction with the virtual string and the type of musical instrument, the one of the at least one actuators configured to output the first haptic effect localized to the touch screen, and

wherein the processor is further configured to output an actuator signal to one of the at least one actuators, the actuator signal configured to cause a second haptic effect to be output to the housing, the second haptic effect comprising a background haptic effect.

2. The device of claim 1, wherein one of the at least one actuators is configured to output a third haptic effect to the touch screen upon the sensor signal indicating the interaction has finished.

3. The device of claim 1, wherein one of the at least one actuators is configured to output a third haptic effect to the touch screen upon the interaction comprising a predetermined distance from the virtual string.

4. The device of claim 1, wherein one of the at least one actuators is configured to output a third haptic effect to the touch screen upon the interaction comprising a predetermined distance from the virtual string and after a predetermined amount of time.

5. The device of claim 1, wherein the at least one actuator comprises at least two actuators, and wherein a second of the at least two actuators is coupled to the housing and is configured to receive the actuator signal and to output a second haptic effect to the housing.

6. The device of claim 1, wherein the processor is further configured to output the first haptic effect when the interaction comprises a movement across one or more of the virtual strings in a direction from left to right, and to output a third haptic effect when the interaction comprises a movement across one or more of the virtual strings in a direction from right to left, wherein the first haptic effect and the third haptic effect are different haptic effects.

7. A method comprising:

displaying one or more virtual strings of a musical instrument through a touch screen, the touch screen coupled to a housing;

sensing a position of an object in contact with the touch screen;

identifying a haptic event occurring in association with an interaction with one of the one or more virtual strings on the touch screen;

transmitting a first activating signal to one of at least one actuators, wherein the one of the at least one actuators is configured to impart a first haptic effect to the touch screen after determining the haptic event, the first haptic effect based on the type of musical instrument and corresponding to the haptic event, the one of the at least one actuators configured to output the first haptic effect localized to the touch screen;

determining a background haptic event; and

transmitting a second activating signal to one of the at least one actuators, wherein the second activating signal is configured to cause a second haptic effect to the housing, the second haptic effect corresponding to the background haptic event.

8. The method of claim 7, further comprising identifying a second haptic event based on the conclusion of the interaction;

and transmitting a third activating signal to the actuator, the third activating signal based on the second haptic event.

9. The method of claim 7, further comprising transmitting a third activating signal to the actuator, the third actuating signal based on a third haptic effect indicating the interaction comprising a drag within a predetermined distance from the virtual string.

10. The method of claim 7, further comprising transmitting a third activating signal to the actuator, the third actuating signal based on a second haptic effect indicating the interaction comprising a drag within a predetermined distance from the virtual string and after a predetermined amount of time.

11. The method of claim 7, wherein the at least one actuator comprises at least two actuators, and wherein a second of the at least two actuators is configured to receive the second activating signal and to output the second haptic effect to the housing.

12. The method of claim 7, wherein the haptic event comprises a movement across one or more of the virtual strings in a direction from left to right.

13. The method of claim 12, further comprising:

identifying a second haptic event occurring in association with an interaction with one of the one or more virtual strings on the touch screen, the haptic event comprises a movement across one or more of the virtual strings in a direction from right to left; and

transmitting a third activating signal to one of at least one actuators, wherein the one of the at least one actuators is configured to impart a second haptic effect corresponding to the second haptic event to the touch screen after determining the second haptic event, the one of the at least one actuators configured to output the second haptic effect localized to the touch screen.

14. A computer-readable medium comprising:

program code for displaying one or more virtual strings of a musical instrument through a touch screen, the touch screen coupled to a housing;

program code for sensing a position of an object in contact with the touch screen;

program code for identifying a haptic event occurring in association with an interaction with one of the one or more virtual strings on the touch screen;

program code for transmitting a first activating signal to one of at least one actuators, wherein the one of the at least one actuators is configured to impart a first haptic effect to the touch screen after determining the haptic event, the first haptic effect based on the type of musical instrument and corresponding to the haptic event, the one of the at least one actuators configured to output the first haptic effect localized to the touch screen;

program code for determining a background haptic event; and

program code for transmitting a second activating signal to one of the at least one actuators, wherein the second activating signal is configured to cause a second haptic effect to be output to the housing, the second haptic effect corresponding to the background haptic event.

15. The computer-readable medium of claim 14, further comprising program code for identifying a second haptic event based on the conclusion of the interaction;

and transmitting a third activating signal to one of the at least one actuators, the third activating signal based on the second haptic event.

16. The computer-readable medium of claim 14, further comprising program code for transmitting a third activating signal to one of the at least one actuators, the third actuating signal based on a third haptic effect indicating the interaction comprising a drag within a predetermined distance from the virtual string.

17. The computer-readable medium of claim 14, further comprising program code for transmitting a third activating signal to one of the at least one actuators, the third actuating signal based on a second haptic effect indicating the interaction comprising a drag within a predetermined distance from the virtual string and after a predetermined amount of time.

18. The computer-readable medium of claim 14, wherein the background haptic event comprises one of an event corresponding to a correct timing of the interaction with the virtual strings, an event corresponding to the audio of notes being played, an event corresponding to a note streak, or an event corresponding to a distraction event.

19. The computer-readable medium of claim 14, wherein the at least one actuator comprises at least two actuators, and wherein a second of the at least two actuators is configured to receive the second activating signal and to output the second haptic effect to the housing.

20. The computer-readable medium of claim 14, wherein the haptic event comprises a movement across one or more of the virtual strings in a direction from left to right.

21. The computer-readable medium of claim 20, further comprising:

program code for identifying a second haptic event occurring in association with an interaction with one of the one or more virtual strings on the touch screen, the haptic event comprises a movement across one or more of the virtual strings in a direction from right to left; and

program code for transmitting a third activating signal to one of at least one actuators, wherein the one of the at least one actuators is configured to impart a second haptic effect corresponding to the second haptic event to the touch screen after determining the second haptic event, the one of the at least one actuators configured to output the second haptic effect localized to the touch screen.