Dynamic video annotation

• US 20040068758A1
• Filed: 10/02/2002
• Published: 04/08/2004
• Est. Priority Date: 10/02/2002
• Status: Abandoned Application

• Current Assignee: HRL Laboratories LLC (The Boeing Co.)
• Original Assignee: HRL Laboratories LLC (The Boeing Co.)
• Inventors: Martin, Kevin, Neely, Howard III, Azuma, Ronald, Daily, Mike
• Application Number:
  US10/263,925
• Publication Number:
  US 20040068758A1
• Time in Patent Office: Days
• US Class Current: 725/136
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

The present invention allows a broadcaster 300a to encode a plurality of data, a portion of which may be from databases 302a, including spatial content and tracking data into a signal, the signal is sent to an overlay construction module 304a. Augmentation layers 306a, provided by users 308a are conveyed to the overlay construction module 304, where the signals are separably merged with the broadcast signal to create an augmented signal, which is transmitted, optionally via satellite 310a, to users 308a. The users 308a receive the augmented signal and display only the layers of interest to them. Thus each user may select a unique overlay combination, and experience individualized programming that more closely comports with that user'"'"'s tastes.

Claims

1. A method for interactively augmenting full motion video, comprising the steps of:

i. providing a full motion video signal through a broadcaster;

ii. providing at least one augmenting layer to the full motion video, wherein the provided layer is directed to at least one of the following;

a. a broadcaster, with instructions on where to maintain the augmenting layer relative to the existing displayed elements and

b. a user, with continuing instructions on where to maintain the augmenting layer; and

iii. allowing the user to selectively view the at least one augmenting layer.

2. A method for interactively augmenting full motion video as set forth in claim 1, wherein the augmenting layer is created by adding at least one of the following layers:

i. a geo-located data layer;

ii. a virtual spaces layer;

iii. an audio chat layer;

iv. a text chat layer; and

v. a comments and contextual information layer.

3. A method for interactively augmenting full motion video as set forth in claim 2, wherein the augmenting layers are merged and combined with the broadcast video image to produce a final video stream.

4. A method for interactively augmenting full motion video as set forth in claim 2, wherein a user may selectively turn the augmenting layers on or off.

5. A method for interactively augmenting full motion video as set forth in claim 2, wherein the augmenting layers takes at least one of the following forms:

i. a transparent overlay;

ii. spatial enhancement of specified image components; and

iii. an opaque overlay.

6. A method for interactively augmenting full motion video as set forth in claim 2, wherein the augmenting layers include dynamic spatially located augmenting layers that the at least one user can either select from or create.

7. A method for interactively augmenting full motion video as set forth in claim 1, wherein information annotations may be selected by the at least one user based on augmenting layers that are appropriate to their interests.

8. A method for interactively augmenting full motion video as set forth in claim 1, wherein the augmenting layers enable communication between viewers through the information in the layers.

9. A method for interactively augmenting full motion video as set forth in claim 1, wherein a plurality of the augmenting layers are provided by the full motion video broadcaster.

10. A method for interactively augmenting full motion video as set forth in claim 9, wherein the plurality augmenting layers provided by the full motion video broadcaster includes:

i. statistics relevant to the programming;

ii. historical data relevant to the programming; and

iii. commentary specifically directed to a subset of viewers.

11. A method for interactively augmenting full motion video as set forth in claim 1, wherein the augmenting layer is conveyed to a full motion video broadcaster and broadcaster transmits the full motion video signal and augmenting layer signal.

12. A method for interactively augmenting full motion video as set forth in claim 1, wherein the user interface communicates utilizing at least one of the following:

i. an Internet connection;

ii. a wireless network;

iii. a telephone line; and

iv. a local satellite uplink.

13. A method for interactively augmenting full motion video as set forth in claim 12, wherein the telephone line communicates the augmenting layer:

i. to at least one user, without going through a broadcaster;

or

ii. to at least one user via a broadcaster.

14. A method for interactively augmenting full motion video as set forth in claim 1, wherein the Internet connection communicates the augmenting layer:

i. to at least one user, without going through a broadcaster;

or

ii. to at least one user via a broadcaster.

15. An apparatus for interactively augmenting full motion video, comprising:

i. a means for receiving and displaying full motion video;

ii. a user interface configured to allow at least one user to provide an augmenting layer of data to a full motion video stream;

iii. a means for viewing augmented full motion video from at least one location.

16. An apparatus for interactively augmenting full motion video as set forth in claim 15, wherein the user interface, allows the at least one user to provide augmentation data and augmentation data placement instructions,

17. An apparatus for interactively augmenting full motion video as set forth in claim 15, wherein the user interface includes a tracking means for keeping augmentation in a user specified position relative to an object displayed despite movement within a scene.

18. An apparatus for interactively augmenting full motion video as set forth in claim 15, wherein the user interface is selected from at least one of the following:

i. a mouse;

ii. a keypad;

iii. an e-pen and c-pad; and

iv. a microphone.

19. An apparatus for interactively augmenting full motion video as set forth in claim 15, wherein the user interface is operatively interconnected with at least one of the following sources of augmenting data:

i. a distributed database;

ii. a remote database; and

iii. a local database.

20. An apparatus for interactively augmenting full motion video as set forth in claim 15, wherein the user interface communicates utilizing at least one of the following:

v. an Internet connection;

vi. a wireless network;

vii. a telephone line; and

viii. a local satellite uplink.

21. An apparatus for interactively augmenting full motion video as set forth in claim 15, wherein the user interface includes at least one of the following:

i. a means for selectively displaying augmentation layers;

ii. a plurality of strategically electromechanical transmitters;

iii. a full motion video receiver and display terminal; and

iv. at least one electromechanical sensor.

22. A method for interactively augmenting full motion video, comprising the steps of:

i. providing a full motion video signal through a broadcaster;

ii. allowing at least one user to provide at least one augmenting layer to the broadcaster with instructions on how to maintain the augmenting layer relative to elements existing in the full motion video; and

iii. transmitting the augmented signal to at least one user.