Haptic broadcast with select haptic metadata based on haptic playback capability

• US 10,320,501 B2
• Filed: 08/02/2018
• Issued: 06/11/2019
• Est. Priority Date: 02/08/2017
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Heubel, Robert W., Raynes, Paige
• Primary Examiner(s): Rushing, Mark S
• Application Number:
  US16/052,878
• Publication Number:
  US 20180343075A1
• Time in Patent Office: 313 Days
• Field of Search: 3404071
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: H04H 20/86 Arrangements characterised by the broadcast information itself

Abstract

Broadcasting select haptic metadata includes broadcasting a broadcast signal to haptic-enabled devices. In response, haptic playback capability information is received at a host source from a haptic-enabled device when original haptic metadata in the broadcast signal encodes haptic information incompatible with the haptic playback capability information. The select haptic metadata, which is customized for the haptic playback capability information, is generated and sent from the host source to the haptic-enabled device.

Claims

1. A method of broadcasting select haptic metadata using a broadcast signal, comprising:

receiving haptic playback capability information at a host source from a plurality of haptic-enabled devices when original haptic metadata received by the haptic-enabled devices encodes haptic information incompatible with the haptic playback capability information;

generating the select haptic metadata customized for the haptic playback capability information;

multiplexing the select haptic metadata with additional metadata to generate a broadcast signal; and

broadcasting the broadcast signal with the select haptic metadata to the haptic-enabled devices.

2. The method of claim 1, wherein the multiplexing the select haptic metadata with additional metadata includes multiplexing the select haptic metadata with audio/video (A/V) metadata used to generate the original haptic metadata.

3. The method of claim 2, wherein the A/V metadata is from an original broadcast signal containing the original haptic metadata.

4. The method of claim 1, wherein the generating the select haptic metadata includes selecting the select haptic metadata from a designated database.

5. The method of claim 1, wherein the generating the select haptic metadata includes modifying the original haptic metadata, and

the modifying includes adding additional haptic metadata to the original haptic metadata, removing unusable haptic metadata from the original haptic metadata, or changing at least one parameter of the original haptic metadata.

6. The method of claim 1, further comprising:

collecting haptic data from sensors,

wherein the select haptic metadata is generated from the haptic data.

7. The method of claim 1, wherein the receiving of the haptic playback capability information includes receiving at least one selected from (i) a device type, and (ii) hardware configured to generate haptic effects, for the haptic-enabled devices, before playback of a haptic track corresponding to the original haptic metadata.

8. A haptic broadcast system, comprising:

a broadcast network broadcasting a broadcast signal to a plurality of haptic-enabled devices, the broadcast signal including select haptic metadata;

a host source from which the broadcast network receives the select haptic metadata, the host source

(i) receiving haptic playback capability information from the haptic-enabled devices when original haptic metadata received by the haptic-enabled devices encodes haptic information incompatible with the haptic playback capability information, and

(ii) generating the select haptic metadata customized for the haptic playback capability information; and

a multiplexer multiplexing the select haptic metadata with additional metadata to generate the broadcast signal.

9. The haptic broadcast system of claim 8, wherein the additional metadata is audio/video (A/V) metadata used to generate the original haptic metadata.

10. The haptic broadcast system of claim 9, wherein the multiplexer obtains the A/V metadata from an original broadcast signal containing the original haptic metadata.

11. The haptic broadcast system of claim 8, wherein the host source generates the select haptic metadata by selecting the select haptic metadata from a designated database.

12. The haptic broadcast system of claim 8, wherein the host source generates the select haptic metadata by modifying the original haptic metadata, and

the modifying includes adding additional haptic metadata to the original haptic metadata, removing unusable haptic metadata from the original haptic metadata, or changing at least one parameter of the original haptic metadata.

13. The haptic broadcast system of claim 8, wherein

the host source further collects haptic data from sensors, and generates the select haptic metadata from the haptic data.

14. The haptic broadcast system of claim 8, wherein

the haptic playback capability information includes at least one selected from (i) a device type, and (ii) hardware configured to generate haptic effects, for the haptic-enabled devices, and

the host source is configured to receive the haptic playback capability information before playback of a haptic track corresponding to the original haptic metadata.

15. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to perform the instructions, comprising:

receive, at a host source, haptic playback capability information from a plurality of haptic-enabled devices when original haptic metadata received by the haptic-enabled devices encodes haptic information incompatible with the haptic playback capability information;

generate, at the host source, select haptic metadata customized for the haptic playback capability information;

multiplex the select haptic metadata with additional metadata to generate a broadcast signal; and

broadcast the broadcast signal with the select haptic metadata to the haptic-enabled devices.

16. The non-transitory computer-readable medium of claim 15, wherein the additional metadata is audio/video (A/V) metadata used to generate the original haptic metadata.

17. The non-transitory computer-readable medium of claim 16, wherein the A/V metadata is from an original broadcast signal containing the original haptic metadata.

18. The non-transitory computer-readable medium of claim 15, wherein to generate the select haptic metadata includes to select the select haptic metadata from a designated database.

19. The non-transitory computer-readable medium of claim 15, wherein to generate the select haptic metadata includes to modify the original haptic metadata, and

to modify the original haptic metadata includes to add additional haptic metadata to the original haptic metadata, to remove unusable haptic metadata from the original haptic metadata, or to change at least one parameter of the original haptic metadata.

20. The non-transitory computer-readable medium of claim 15, wherein

the instructions further cause the processor to collect, at the host source, haptic data from sensors, and generate the select haptic metadata from the haptic data.