Video token tracking system for animation

• US 6,441,825 B1
• Filed: 10/04/1999
• Issued: 08/27/2002
• Est. Priority Date: 10/04/1999
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Peters, Geoffrey W.
• Primary Examiner(s): Vo, Cliff N.
• Application Number:
  US09/411,201
• Time in Patent Office: 1,058 Days
• Field of Search: 345/418, 345/473, 345/474, 345/475
• US Class Current: 345/473
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments

Abstract

An animation system includes a video source filter, a tracker, a command recognizer, a character synthesizer, a character store, an overlay module, a video rendering filter and, optionally, a video store. The video source filter routes input video data to a tracker and a command recognizer. The command recognizer identifies predetermined patterns in the video input information and identifies the type of patterns. The tracker identifies the predetermined patterns in the video information and identifies the coordinates of the predetermined patterns. Based upon one or more types output by the command recognizer, the character synthesizer retrieves animation information from the character store. Places the retrieved animation information at coordinates identified by the tracker. The character synthesizer outputs animation information to the overlay module. The overlay module generates a composite video signal from the animation information and possibly other video information and now puts it to the video rendering filter. The video rendering filter outputs the composite video information to a video display.

Claims

1. An animation system comprising:

a tracker having an input for video input data, the tracker to identify a location and type of a token contained in the video input data,

a command recognizer having an input adapted to receive video input data, to identify a type of the token,

a character store having a plurality of characters indexed by token types, and

a character synthesizer in communication with the tracker, the command recognizer and the character store, to retrieve one of the characters from the character store based upon token type and to place the character in an output video data at the location of the token.

2. The animation system of claim 1, further comprising an overlay module in communication with the character synthesizer and having an input for a second video data.

3. The animation system of claim 2, wherein the overlay module input is in communication with the video input data.

4. The animation system claim 2, further comprising a video store provided in communication with the overlay module input.

5. The animation system of claim 2, wherein the overlay module input for the second video data via a computer network.

6. The animation system of claim 1, further comprising a second tracker to identify a location of a second token contained in a second video input data and a second command recognizer to identify a type of the second token contained in the second video input data each adapted to receive the second input video data and in communication with the character synthesizer.

7. The animation system of claim 1, further comprising a phoneme analyzer adapted to receive audio input data and in communication with the character synthesizer.

8. The animation system of claim 7, further comprising an audio effect filter adapted to receive the audio input data and provided in communication with the character store.

9. An animation method, comprising:

receiving an input video data signal,

recognizing a predetermined pattern within the input video data signal,

determining which one of a plurality of positions and types of predetermined patterns is contained within the input video data signal,

based upon the type of predetermined pattern, retrieving character data from a memory,

placing the character data in a video output signal based upon the position of the predetermined pattern,

determining a movement of the predetermined pattern within the input video data signal, and

moving the character data within the video output signal according to the movement of the predetermined pattern within the input video data signal.

10. The method of claim 9, wherein the placing step includes superimposing the character data over a second video data.

11. The method of claim 10, wherein the second video data is the input video data.

12. The method of claim 11, wherein the second video data is retrieved from a second memory.

13. The method of claim 11, wherein the second video data is received from a computer network.

14. The method of claim 9, further comprising:

receiving an input audio signal,

decoding the audio signal, and

animating the retrieved character data based on the decoded audio signal.

15. The method of claim 14, wherein the decoding step includes detecting phonemes from the input audio signal.

16. The method of claim 9, further comprising receiving an input audio signal, and based on the type of input audio signal, altering the input audio signal, and outputting the altered audio signal.

17. A computer readable medium having stored thereon program instructions that, when executed by a processor, cause the processor to:

receive an input video signal,

recognize a predetermined pattern within the input video signal,

determine which one of a plurality of positions and types of the predetermined pattern is contained within the input video signal,

based on the type of the predetermined pattern, associate character data with the predetermined pattern, wherein the character data includes audio data associated with video data,

based on the position of the predetermined pattern, place the character data in a video output signal, and

output the video output signal.

18. A video data signal, created according to the process of:

receiving an input video signal,

recognizing a predetermined pattern within the input video signal,

determining which one of a plurality of positions and types of the predetermined pattern is contained within the input video signal,

based on the type of the predetermined pattern, associating character data with the predetermined pattern, wherein the character data comprises audio data and video data,

based on the position of the predetermined pattern, placing the character data in a video output signal,

outputting the video output signal.

19. An animation system, comprising:

a source of input audio-visual data, including at least one token,

a tracker to identify a location of the token in the audio-visual data,

a command recognizer to identify a type of the token,

a character synthesizer to receive the type and location of the token and to retrieve data from a character store according to the type of the token,

the character store including phonemes and character video data, and

a rendering filter to output the character data at the location of the token in a display of output audio-visual data.

20. The animation system of claim 19 wherein the tracker identifies the location of the token in the input audio-visual data according to a set of coordinates and the rendering filter outputs the character data in the location determined by the coordinates.