Method and apparatus to provide haptic feedback based on media content and one or more external parameters

• US 9,274,603 B2
• Filed: 02/14/2014
• Issued: 03/01/2016
• Est. Priority Date: 05/24/2013
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Modarres, Ali, Ullrich, Christopher J., Phan, Loc, Bhatia, Satvir Singh, Rank, Stephen D., Dionne, Jean Francois
• Primary Examiner(s): Tweel, Jr., John A
• Application Number:
  US14/181,144
• Publication Number:
  US 20140347176A1
• Time in Patent Office: 746 Days
• Field of Search: 340/407.1, 715/702
• US Class Current: 1/1
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems

Abstract

The disclosure relates to systems and methods of providing haptic feedback based on media content and one or more external parameters used to customize the haptic feedback. The system may modify or otherwise alter haptic feedback that is determined using the media content alone. In other words, the system may use both the media content and the external parameters to determine haptic feedback that should be output to the user or others. The external parameters may include, for example, sensor information, customization information, and/or other external parameters that may be used to customize the haptic feedback.

Claims

1. A method of generating haptic feedback, the method comprising:

receiving, by a processor, media content;

receiving at least one external parameter comprising sensor information from one or more sensors;

generating a control signal based on the media content and the at least one external parameter, wherein the control signal is configured to cause haptic feedback; and

providing the control signal to a haptic output device.

2. The method of claim 1, wherein the sensor information comprises a biometric measurement of a user.

3. The method of claim 1, wherein the sensor information comprises an environmental measurement of an environment.

4. The method of claim 1, further comprising:

determining a level of activity of a user based on the sensor information, wherein the control signal is generated based on the level of activity of the user.

5. The method of claim 1, further comprising:

receiving second sensor information after the sensor information; and

discontinuing or altering the control signal based on the second sensor information.

6. The method of claim 1, further comprising:

processing the media content;

determining intrinsic information of the media content based on the processing, wherein the intrinsic information indicates a characteristic of the media content, wherein the control signal is generated based on the intrinsic information.

7. The method of claim 6, wherein generating the control signal comprises:

determining a first value for a first parameter of the haptic feedback based on the intrinsic information; and

determining a second value for a second parameter of the haptic feedback based on the sensor information.

8. The method of claim 7, wherein the first parameter comprises a periodicity of the haptic feedback and the intrinsic information comprises a tempo of the media content.

9. The method of claim 7, wherein the second parameter comprises a quantity, a magnitude, or a type of haptic feedback that is varied based on the sensor information.

10. The method of claim 6, wherein generating the control signal comprises:

determining haptic feedback based on the intrinsic information; and

generating the control signal such that the haptic feedback based on the intrinsic information is scaled up or down based on the sensor information.

11. The method of claim 1, wherein providing the control signal to the haptic output device comprises:

providing the control signal to;

(i) a haptic output device that is housed with the processor, or (ii) to a haptic output device that is remote and separately housed from the processor.

12. The method of claim 1, wherein the at least one external parameter comprises customization information used to customize the haptic feedback.

13. The method of claim 12, wherein the customization information comprises profile information that indicates a user selectable preference such that the haptic feedback is customized based on the user selectable preference.

14. The method of claim 13, wherein receiving the customization information comprises receiving the profile information from a user, wherein the profile information is selectable by the user from among a plurality of profiles.

15. The method of claim 12, wherein the customization information comprises an indication of a type of the haptic output device, wherein the control signal is generated such that the haptic feedback is customized based on the type of the haptic output device.

16. The method of claim 12, wherein the customization information comprises use case information that indicates a type of the media content such that the haptic feedback is customized based on the type of the media content.

17. The method of claim 16, wherein the type of the media content comprises a video, a series of two or more still images, an audio, or a video game content.

18. The method of claim 16, wherein receiving the customization information comprises automatically detecting the type of the media content.

19. The method of claim 18, wherein automatically detecting the type of the media content comprises determining an application running in a foreground.

20. The method of claim 12, wherein the customization information comprises profile information that indicates a user selectable preference and a type of the haptic output device such that the haptic feedback is customized based on the user selectable preference and the type of the haptic output device.

21. The method of claim 12, wherein the customization information comprises profile information that indicates a user selectable preference and a type of the media content such that the haptic feedback is customized based on the user selectable preference and the type of media content.

22. The method of claim 21, wherein the customization information comprises an indication of a type of the haptic output device such that the haptic feedback is customized based on the user selectable preference, the type of media content, and the type of haptic output device.

23. The method of claim 12, wherein generating the control signal comprises identifying a processing instruction from among a plurality of processing instructions each used to determine haptic feedback based on the media content, the identified processing instruction corresponding to the customization information.

24. The method of claim 1, wherein the at least one external parameter is based on at least one characteristic of the media content.

25. A device configured to generate haptic feedback, the device comprising:

a processor programmed to;

receive media content;

receive at least one external parameter comprising sensor information from one or more sensors;

generate a control signal based on the media content and the at least one external parameter, wherein the control signal is configured to cause haptic feedback; and

provide the control signal to a haptic output device.

26. The device of claim 25, wherein the at least one external parameter further comprises customization information.