Synchronization of haptic effect data in a media transport stream
First Claim
Patent Images
1. A method for synchronizing haptic effects, comprising:
- identifying haptic information in one or more frames of a media transport stream, wherein the media transport stream comprises the haptic information and at least one of;
audio information or video information;
determining one or more time stamps according to a master time code embedded within the media transport stream, wherein the master time code comprises the one or more time stamps, wherein the master time code is used to synchronize the haptic information and at least one of the audio information or the video information;
assigning at least one of the one or more time stamps to each of the one or more frames, wherein the assigned time stamp indicates a time for activating at least one actuator in response to the haptic information; and
defining effect information for each haptic effect in response to the haptic information in the one or more frames.
1 Assignment
0 Petitions
Accused Products
Abstract
Haptic information in a series of frames of a media transport stream is identified and time stamps corresponding thereto are determined in accordance with a master time code signal embedded in the media transport stream. Each media transport stream frame containing haptic information is subsequently assigned a time stamp so that it will be used to activate an actuator at a proper time responsive to the time stamp to generate a haptic effect in accordance with the haptic information.
-
Citations
30 Claims
-
1. A method for synchronizing haptic effects, comprising:
-
identifying haptic information in one or more frames of a media transport stream, wherein the media transport stream comprises the haptic information and at least one of;
audio information or video information;determining one or more time stamps according to a master time code embedded within the media transport stream, wherein the master time code comprises the one or more time stamps, wherein the master time code is used to synchronize the haptic information and at least one of the audio information or the video information; assigning at least one of the one or more time stamps to each of the one or more frames, wherein the assigned time stamp indicates a time for activating at least one actuator in response to the haptic information; and defining effect information for each haptic effect in response to the haptic information in the one or more frames. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method for transmitting and playing a haptic signal embedded in a media transport stream, the method comprising:
-
parsing the haptic signal into successive frames having a substantially fixed length of time, wherein each frame is assigned an initial time at which it should be played according to a master time code for playing the media transport stream, wherein the master time code is embedded within the media transport stream and comprises one or more time stamps, each time stamp indicating an initial time at which a particular frame should be played; defining effect information for each frame for each haptic effect to be played within a time span of the frame; encoding the frames as a haptic component in the media transport stream; transporting the media transport stream; receiving the media transport stream at a playback device; extracting a media component and the haptic component; playing the media component; and synchronizing the haptic component with the media component by playing each frame at its assigned initial time according to the master time code. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. An apparatus for synchronizing haptic effects, comprising:
-
means for identifying haptic information in one or more frames of a media transport stream, wherein the media transport stream comprises the haptic information and at least one of;
audio information or video information;means for determining one or more time stamps according to a master time code embedded within the media transport stream, wherein the master time code comprises the one or more time stamps, wherein the master time code is used to synchronize the haptic information and at least one of the audio information or the video information; means for assigning at least one of the one or more time stamps to each of the one or more frames, wherein the assigned time stamp indicates a time for activating at least one actuator in response to the haptic information; and means for defining effect information for each haptic effect in response to the haptic information in the one or more frames. - View Dependent Claims (21, 22, 23, 24, 25, 26, 27, 28)
-
-
29. An apparatus for embedding a haptic signal in a media transport stream, comprising:
-
means for parsing the haptic signal into one or more frames having a same fixed length of time; means for assigning the frames initial times for play associated with the haptic signal and at least one of;
an audio signal or a video signal, the initial times for play associated with a master time code embedded within the media transport stream, wherein the master time code comprises one or more time stamps, each time stamp indicating an initial time for play for a particular frame, wherein the master time code is used to synchronize the haptic signal and at least one of the audio signal or the video signal; andmeans for defining effect information for each haptic effect to be played within a time span of each frame.
-
-
30. An apparatus for transmitting and playing a haptic signal embedded in a media transport stream, comprising:
-
means for parsing the haptic signal into successive frames having a fixed length of time, wherein each frame is assigned an initial time at which it should be played according to a master time code embedded within the media transport stream, wherein the master time code comprises one or more time stamps, each time stamp indicating an initial time at which a particular frame should be played, wherein the media transport stream comprises the haptic signal and at least one of;
an audio signal or a video signal, and wherein the master time code is used to synchronize the haptic signal and at least one of the audio signal or the video signal;means for defining effect information for each frame for each haptic effect to be played within a time span of the frame; means for encoding the frames as a haptic component in the media transport stream; means for transporting the transport stream; means for receiving the media transport stream at a playback device; means for extracting a media component and the haptic component; means for playing the media component; and means for synchronizing the haptic component with the media component by playing each frame at its assigned initial time according to the master time code.
-
Specification