Customizing haptic feedback in live events

• US 10,176,680 B2
• Filed: 06/19/2017
• Issued: 01/08/2019
• Est. Priority Date: 09/16/2015
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Saboune, Jamal, Cruz-Hernandez, Juan Manuel, Wu, Liwen, Hamam, Abdelwahab
• Primary Examiner(s): Mullen, Thomas
• Application Number:
  US15/626,442
• Publication Number:
  US 20170287293A1
• Time in Patent Office: 568 Days
• Field of Search: 3404071, 434114
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems

Abstract

A method of generating event identifiers includes receiving sensor information from tracked entities. Based on the sensor information for tracked entities, an event can be determined. An event ID can be assigned to the event based on the type of event that was determined. The event ID can be sent to a haptically enabled device, the device outputting a haptic effect determined from the event ID.

Claims

1. A method for applying a haptic effect, the method comprising:

receiving sensor information from a sensor output signal generated by a sensor on an object;

encoding, in a packet containing metadata for the sensor, a haptic event based on the sensor information, the haptic event being an event for which the haptic effect is to be provided, and the packet being used to generate a haptic signal; and

applying the haptic effect by processing the haptic signal.

2. The method of claim 1, further comprising:

transmitting the packet to a haptic output device when transmitting at least one of an audio feed or a video feed to the haptic output device, the haptic output device being remote from the sensor,

wherein the at least one of the audio feed or the video feed is associated with the haptic event.

3. The method of claim 1, further comprising:

transmitting the packet with at least one of an audio feed or a video feed to a haptic output device, the haptic output device being remote from the sensor,

wherein the at least one of the audio feed or the video feed is associated with the haptic event.

4. The method of claim 1, wherein

the haptic effect is a vibrational haptic effect, and

the vibrational haptic effect is a representation of the haptic event.

5. The method of claim 1, wherein the encoding of the haptic event from the sensor information includes matching the sensor information to a pattern profile of a known haptic event.

6. The method of claim 1, wherein the sensor information is received at a process server remote from the sensor, and

the method further comprises:

transmitting the packet to a haptic output device, the haptic output device being remote from the process server.

7. The method of claim 1, further comprising:

assigning an event ID to the haptic event; and

merging the event ID into the packet, wherein the metadata includes at least one of a classification ID or a source ID that is particular to the sensor.

8. The method of claim 7, wherein

the packet contains a multichannel feed, and

the method further comprises:

providing the event ID and the at least one of the classification ID or the source ID in a first haptic channel of the multichannel feed.

9. The method of claim 1, further comprising:

receiving at least one of video or audio information during the receiving of the sensor information,

wherein the at least one of video or audio information is associated with the haptic event.

10. A method for applying a haptic effect, the method comprising:

receiving sensor information from a sensor output signal generated by a sensor on an object;

identifying a haptic event based on the sensor information, the haptic event being an event for which the haptic effect is to be provided;

assigning an event ID to the haptic event;

generating a haptic signal based on the event ID and a force element, the force element being metadata associated with the event ID, a parameter specified by the event ID or a parameter separate from the event ID; and

applying the haptic effect by processing the haptic signal.

11. The method of claim 10, further comprising:

transmitting the event ID and the force element to a haptic output device when transmitting at least one of an audio feed or a video feed to the haptic output device, the haptic output device being remote from the sensor,

wherein the at least one of the audio feed or the video feed is associated with the haptic event.

12. The method of claim 10, further comprising:

transmitting the event ID and the force element with at least one of an audio feed or a video feed to a haptic output device, the haptic output device being remote from the sensor,

wherein the at least one of the audio feed or the video feed is associated with the haptic event.

13. The method of claim 10, wherein

the haptic effect is a vibrational haptic effect, and

the vibrational haptic effect is a representation of the haptic event.

14. The method of claim 10, wherein the identifying of the haptic event from the sensor information includes matching the sensor information to a pattern profile of a known haptic event.

15. The method of claim 10, wherein the force element is the metadata associated with the event ID.

16. The method of claim 10, further comprising:

merging the event ID into a packet containing metadata for the event ID, wherein the metadata is particular to the sensor,

wherein the generating of the haptic signal includes using the packet.

17. The method of claim 16, wherein

the metadata includes at least one of a classification ID or a source ID that is particular to the sensor,

the packet contains a multichannel feed, and

the method further comprises:

providing the event ID and the at least one of the classification ID or the source ID in a first haptic channel of the multichannel feed.

18. The method of claim 10, further comprising:

receiving at least one of video or audio output during the receiving of the sensor information,

wherein the at least one of video or audio output is associated with the haptic event.

19. The method of claim 18, further comprising:

providing the at least one of video or audio output during the applying of the haptic effect.

20. A non-transitory computer-readable medium on which is encoded instructions that, when executed by one or more processors, configure the one or more processors to perform operations comprising:

receiving sensor information from a sensor output signal generated by a sensor on an object;

encoding, in a packet containing metadata for the sensor, a haptic event based on the sensor information, the haptic event being an event for which a haptic effect is to be provided, and the packet being used to generate a haptic signal; and

applying the haptic effect by processing the haptic signal.