Haptic broadcast with select haptic metadata based on haptic playback capability

• US 10,075,251 B2
• Filed: 02/08/2017
• Issued: 09/11/2018
• Est. Priority Date: 02/08/2017
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Heubel, Robert W., Raynes, Paige
• Primary Examiner(s): RUSHING, MARK S
• Application Number:
  US15/427,240
• Publication Number:
  US 20180227063A1
• Time in Patent Office: 580 Days
• Field of Search: 3404071, 3406911, 3406918
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: H04H 20/86 Arrangements characterised by the broadcast information itself

Abstract

Broadcasting select haptic metadata includes broadcasting a broadcast signal to haptic-enabled devices. In response, haptic playback capability information is received at a host source from a haptic-enabled device when original haptic metadata in the broadcast signal encodes haptic information incompatible with the haptic playback capability information. The select haptic metadata, which is customized for the haptic playback capability information, is generated and sent from the host source to the haptic-enabled device.

Claims

1. A method of broadcasting select haptic metadata using a broadcast signal, comprising:

broadcasting the broadcast signal from a host source to a plurality of haptic-enabled devices, the broadcast signal including original haptic metadata;

receiving a first haptic playback capability information at the host source from a first haptic-enabled device of the plurality of haptic-enabled devices when the original haptic metadata encodes haptic information incompatible with the first haptic playback capability information;

generating the select haptic metadata customized for the first haptic playback capability information; and

sending the select haptic metadata from the host source to the first haptic-enabled device.

2. The method according to claim 1, wherein the generating the select haptic metadata includes selecting the select haptic metadata from a designated database.

3. The method according to claim 1, wherein

the generating the select haptic metadata includes modifying the original haptic metadata, and

the modifying includes adding additional haptic metadata to the original haptic metadata, removing unusable haptic metadata from the original haptic metadata, or changing at least one parameter of the original haptic metadata.

4. The method according to claim 1, wherein

the first haptic playback capability information is generated by determining a haptic playback capability of the first haptic-enabled device for the original haptic metadata, and

the determining the haptic playback capability of the first haptic-enabled device includes identifying at least one selected from (i) a device type, and (ii) hardware configured to generate haptic effects, for the first haptic-enabled device using software respectively embedded in the first haptic-enabled device, before playback of a haptic track corresponding to the original haptic metadata.

5. The method according to claim 1, wherein

the first haptic playback capability information is generated by determining a haptic playback capability of the first haptic-enabled device for the original haptic metadata,

the determining the haptic playback capability of the first haptic-enabled device includes identifying at least one selected from (i) a device type, and (ii) hardware configured to generate haptic effects, for the first haptic-enabled device using a validation device, before playback of a haptic track corresponding to the original haptic metadata, and

the validation device is external to the first haptic-enabled device.

6. The method according to claim 1, wherein

the broadcasting the broadcast signal includes sending the broadcast signal to the plurality of haptic-enabled devices via transmission modes different from each other, and

the transmission modes are selected from cable, direct broadcast satellite, a fiber-optic communication network, over-the-air programming, a wireless communication network, and radio waves.

7. The method according to claim 1, wherein

the broadcasting the broadcast signal includes sending the broadcast signal from the host source to the plurality of haptic-enabled devices through a first media broadcast stream,

the receiving the first haptic playback capability information includes receiving the first haptic playback capability information through the first media broadcast stream, and

the sending the select haptic metadata includes sending the select haptic metadata to the first haptic-enabled device through the first media broadcast stream.

8. The method according to claim 1, wherein the haptic information encoded by the original haptic metadata specifies a type of haptic parameter(s) to be played back on the plurality of haptic-enabled devices.

9. A haptic broadcast system, comprising:

a broadcast network broadcasting a broadcast signal to a plurality of haptic-enabled devices, the broadcast signal including original haptic metadata; and

a host source from which the broadcast network receives the original haptic metadata, the host source

(i) receiving a first haptic playback capability information from a first haptic-enabled device of the plurality of haptic-enabled devices when the original haptic metadata encodes haptic information incompatible with the first haptic playback capability information,

(ii) generating select haptic metadata customized for the first haptic playback capability information, and

(iii) sending the select haptic metadata from the host source to the first haptic-enabled device.

10. The haptic broadcast system of claim 9, further comprising:

a designated database from which the select haptic metadata is selected.

11. The haptic broadcast system of claim 9, wherein

the host source includes a select haptic metadata generator generating the select haptic metadata by modifying the original haptic metadata, and

the select haptic metadata generator modifies the original haptic metadata by adding additional haptic metadata to the original haptic metadata, removing unusable haptic metadata from the original haptic metadata, or changing at least one parameter of the original haptic metadata.

12. The haptic broadcast system of claim 9, wherein

the first haptic-enabled device includes (i) embedded software, and (ii) a haptic playback capability generator generating the first haptic playback capability information by determining a haptic playback capability of the first haptic-enabled device for the original haptic metadata, and

the haptic playback capability generator determines the haptic playback capability of the first haptic-enabled device by identifying at least one selected from (i) a device type, and (ii) hardware configured to generate haptic effects, for the first haptic-enabled device using the embedded software in the first haptic-enabled device, before playback of a haptic track corresponding to the original haptic metadata.

13. The haptic broadcast system of claim 9, further comprising:

a validation device externally connected to the first haptic-enabled device,

wherein the first haptic-enabled device includes a haptic playback capability generator generating the first haptic playback capability information by determining a haptic playback capability of the first haptic-enabled device for the original haptic metadata, and

wherein the haptic playback capability generator determines the haptic playback capability of the first haptic-enabled device by identifying at least one selected from (i) a device type, and (ii) hardware configured to generate haptic effects, for the first haptic-enabled device using the validation device, before playback of a haptic track corresponding to the original haptic metadata.

14. The haptic broadcast system of claim 9, wherein

the plurality of haptic-enabled devices receive the broadcast signal via transmission modes different from each other, and

the transmission modes are selected from cable, direct broadcast satellite, a fiber-optic communication network, over-the-air programming, a wireless communication network, and radio waves.

15. The haptic broadcast system of claim 9, wherein

the broadcast network broadcasts the broadcast signal by sending the broadcast signal to the plurality of haptic-enabled devices through a first media broadcast stream, and

the hosts source receives the first haptic playback capability information through the first media broadcast stream, and sends the select haptic metadata to the first haptic-enabled device through the first media broadcast stream.

16. The haptic broadcast system of claim 9, wherein the haptic information encoded by the original haptic metadata specifies a type of haptic parameter(s) to be played back on the plurality of haptic-enabled devices.

17. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to:

broadcast, using a broadcast network, a broadcast signal to a plurality of haptic-enabled devices, the broadcast signal including original haptic metadata received from a host source;

receive, at the host source, a first haptic playback capability information from a first haptic-enabled device of the plurality of haptic-enabled devices when the original haptic metadata encodes haptic information incompatible with the first haptic playback capability information;

generate, at the host source, select haptic metadata customized for the first haptic playback capability information; and

send the select haptic metadata from the host source to the first haptic-enabled device.

18. The non-transitory computer-readable medium of claim 17, wherein

to generate the select haptic metadata includes to modify the original haptic metadata using a select haptic metadata generator in the host source, and

to modify includes to add additional haptic metadata to the original haptic metadata, to remove unusable haptic metadata from the original haptic metadata, or to change at least one parameter of the original haptic metadata.

19. The non-transitory computer-readable medium of claim 17, wherein

the instructions further cause the processor to generate the first haptic playback capability information by determining a haptic playback capability of the first haptic-enabled device for the original haptic metadata using a haptic playback capability generator in the first haptic-enabled device, and

the determining the haptic playback capability of the first haptic-enabled device includes identifying at least one selected from (i) a device type, and (ii) hardware configured to generate haptic effects, for the first haptic-enabled device using either software embedded in the first haptic-enabled device or a validation device external to the first haptic-enabled device, before playback of a haptic track corresponding to the original haptic metadata.

20. The non-transitory computer-readable medium of claim 17, wherein to broadcast, using the broadcast network, the broadcast signal includes sending the broadcast signal to the plurality of haptic-enabled devices via transmission modes different from each other,

the transmission modes being selected from cable, direct broadcast satellite, a fiber-optic communication network, over-the-air programming, a wireless communication network, and radio waves.