Method and System For Providing Haptic Effects Based on Information Complementary to Multimedia Content

• US 20150070150A1
• Filed: 12/31/2013
• Published: 03/12/2015
• Est. Priority Date: 09/06/2013
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Levesque, Vincent, Modarres, Ali, Cruz-Hernandez, Juan Manuel, Saboune, Jamal
• Granted Patent: US 9,652,945 B2
• Time in Patent Office: Days
• US Class Current: 340/407.1
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

The present disclosure is generally directed to systems and methods for providing haptic effects based on information complementary to multimedia content. For example, one disclosed method includes the steps of receiving multimedia data comprising multimedia content and complementary data, wherein the complementary data describes the multimedia content, determining a haptic effect based at least in part on the complementary data, and outputting the haptic effect while playing the multimedia content.

Claims

1. A method comprising:

receiving multimedia data comprising multimedia content and complementary data, wherein the complementary data describes the multimedia content;

determining a haptic effect based at least in part on the complementary data; and

outputting the haptic effect while playing the multimedia content.

2. The method of claim 1, wherein the complementary data comprises closed caption data.

3. The method of claim 1, wherein the complementary data comprises subtitle information.

4. The method of claim 1, wherein the complementary data comprises a script.

5. The method of claim 1, wherein the complementary data comprises tag data.

6. The method of claim 1, wherein determining the haptic effect based at least in part on the complementary data comprises determining a haptic effect based on the multimedia content and the complementary data.

7. The method of claim 1, wherein determining the haptic effect based at least in part on the complementary data comprises:

determining a haptic theme based at least in part on the complementary data; and

determining a haptic effect based on the complementary data and the haptic theme.

8. A computer readable medium comprising software program code executable by a processor to:

receive multimedia data comprising multimedia content and complementary data, wherein the complementary data describes the multimedia content;

determine a haptic effect based at least in part on the complementary data; and

output the haptic effect while playing the multimedia content.

9. The computer readable medium of claim 8, wherein the complementary data comprises closed caption data.

10. The computer readable medium of claim 8, wherein the complementary data comprises subtitle information.

11. The computer readable medium of claim 8, wherein the complementary data comprises a script.

12. The computer readable medium of claim 8, wherein the complementary data comprises tag data.

13. The computer readable medium of claim 8, wherein determining the haptic effect based comprises determining a haptic effect based on the multimedia content and the complementary data.

14. The computer readable medium of claim 8, wherein determining the haptic effect based at least in part on the complementary data comprises:

determining a haptic theme based at least in part on the complementary data; and

determining a haptic effect based on the complementary data and the haptic theme.

15. A system comprising:

a processor; and

a memory in communication with the processor, the memory comprising computer program code executable by the processor to;

receive multimedia data comprising multimedia content and complementary data, wherein the complementary data describes the multimedia content;

determining a haptic effect based at least in part on the complementary data; and

output the haptic effect while playing the multimedia content.

16. The system of claim 15, wherein the complementary data comprises closed caption data.

17. The system of claim 15, wherein the complementary data comprises subtitle information.

18. The system of claim 15, wherein the complementary data comprises a script.

19. The system of claim 15, wherein the complementary data comprises tag data.

20. The system of claim 15, wherein determining the haptic effect based at least in part on the complementary data comprises determining a haptic effect based on the multimedia content and the complementary data.

21. The system of claim 15, wherein determining the haptic effect based at least in part on the complementary data comprises:

determining a haptic theme based at least in part on the complementary data; and

determining a haptic effect based on the complementary data and the haptic theme.