Object selection using hit test tracks
First Claim
1. A method of providing interactive playback of a movie, the method comprising:
- receiving an indication of a user selection of a location within an image of the movie; and
identifying an action to take in response to the selection of the location by accessing an auxiliary track of data corresponding to the movie, the auxiliary track including, a tag to identify the auxiliary track as the auxiliary track, and hit test data to identify one of a plurality of actions to be taken based on both the image within which the selection was made and the location within the image.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for labeling the pixels within a selected visual area of at least one image frame containing that visual area from a sequence of image frames stored in memory and operative to be displayed on an interactive display so that a user may subsequently select the selected visual area on a pixel accurate, frame accurate basis. To label the selected visual area within an image frame, the scene within that image frame is segmented to identify the selected visual area, each pixel within that selected visual area is then labeled with an area identifier which is unique to that selected visual area, and the pixels containing the area identifiers are mapped into an item buffer. The item buffer is then compressed and stored within a labeled portion of memory linked with the stored frame image from which the item buffer was derived. When a user subsequently selects a pixel within any frame image of the sequence of frame images the pixel is decompressed within the labeled portion of memory corresponding to the pixel in the selected frame image to determine the area identifier for the selected pixel. This area identifier is then used for a number of purposes, such as to identify an area within the frame image corresponding to the selected pixel, or to cause some action related to the selected pixel to be performed.
35 Citations
26 Claims
-
1. A method of providing interactive playback of a movie, the method comprising:
-
receiving an indication of a user selection of a location within an image of the movie; and
identifying an action to take in response to the selection of the location by accessing an auxiliary track of data corresponding to the movie, the auxiliary track including, a tag to identify the auxiliary track as the auxiliary track, and hit test data to identify one of a plurality of actions to be taken based on both the image within which the selection was made and the location within the image. - View Dependent Claims (2, 3, 4, 5, 6, 7)
transmitting a sequence of video images as at least a portion of the movie, the sequence of video images being at least part of a first track corresponding to the movie.
-
-
3. The method of claim 2, wherein the transmitting comprises transmitting the sequence of video images to a display device.
-
4. The method of claim 1, wherein the auxiliary track further includes a track identifier to identify a track of video images, corresponding to the movie, to which the auxiliary track corresponds.
-
5. The method of claim 1, wherein the auxiliary track further includes a data field size indicator identifying a number of bytes of information in the hit test data, a compression format indicator identifying a compression format used to compress the hit test data, and a pixel bit depth indicator identifying a pixel bit depth to which the compressed hit test data is to be decompressed.
-
6. The method of claim 1, wherein the auxiliary track further includes an object to string name mapping table to associate names with objects in a track of video images corresponding to the movie.
-
7. The method of claim 6, wherein the auxiliary track further includes an object to event mapping table to associate events with objects in the track of video images corresponding to the movie.
-
8. A machine-readable medium having stored thereon a series of instructions which, when executed by a processor, cause the processor to:
-
receive an indication of a user selection of a location within an image of a movie; and
identify an action to take in response to the selection of the location by accessing an auxiliary track of data corresponding to the movie, the auxiliary track including, a tag to identify the auxiliary track as the auxiliary track, and hit test data to identify one of a plurality of actions to be taken based on both the image within which the selection was made and the location within the image. - View Dependent Claims (9, 10, 11, 12)
-
-
13. An apparatus comprising:
-
a controller to receive an indication of a user selection of a location within an image of a movie; and
a storage device to store a plurality of tracks of data corresponding to the movie, the plurality of tracks of data including, an auxiliary track that includes both a tag to identify the auxiliary track as the auxiliary track and hit test data that identifies one of a plurality of actions to be taken based on both the image of the movie within which the selection is made and the location within the image. - View Dependent Claims (14, 15, 16)
-
-
17. An apparatus for providing interactive playback of a movie, the apparatus comprising:
-
means for receiving an indication of a user selection of a location within an image of the movie; and
means for identifying an action to take in response to the selection of the location by accessing an auxiliary track of data corresponding to the movie, the auxiliary track including, means for identifying the auxiliary track as the auxiliary track, and first means for identifying one of a plurality of actions to be taken based on both the image within which the selection was made and the location within the image. - View Dependent Claims (18, 19)
-
-
20. An article comprising:
-
a storage medium; and
the storage medium having stored thereon an auxiliary track of data corresponding to a movie, the auxiliary track of data including, an identifier to identify the auxiliary track as the auxiliary track, and hit test data that identifies one of a plurality of actions to be taken based on both an image of a series of video images, corresponding to the movie, within which a selection is made and a location within the image. - View Dependent Claims (21, 22, 23, 24, 25, 26)
-
Specification