Marking and searching capabilities in multimedia documents within multimedia collaboration networks

• US 7,054,904 B2
• Filed: 04/09/2002
• Issued: 05/30/2006
• Est. Priority Date: 10/01/1993
• Status: Expired due to Fees

• Current Assignee: Pragmatus AV LLC (Pragmatus, LLC)
• Original Assignee: Collaboration Properties Incorporated
• Inventors: Lantz, Keith A., Lauwers, J. Chris, Burns, Emmett R., Burnett, Gerald J., Ludwig, Lester F.
• Primary Examiner(s): Dinh, Dung C.
• Application Number:
  US10/120,307
• Publication Number:
  US 20020124051A1
• Time in Patent Office: 1,512 Days
• Field of Search: 709/204, 709/205, 709/206, 709/207, 709/230, 709/231, 709/238, 709/248, 725/87, 725/88, 725/92, 725/101, 725/102, 725/103, 725/141, 725/142, 725/145, 725/153, 345/702, 345/716, 345/723, 345/751, 345/753, 345/756
• US Class Current: 709/205
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04L 12/1818 Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A multimedia collaboration system has multimedia document marking and searching capabilities such that a user can rapidly access desired selected portions of stored multimedia documents. The mark and search feature can be context-based, content-based, time-based, or event based. The multimedia documents can be a collection of individual components in multiple media combined with an overall structure and timing component. The multimedia collaboration system itself integrates separate real-time and asynchronous networks—the former for real-time audio and video, and the latter for control signals and textual, graphical and other data—in a manner that is interoperable across different computer and network operating system platforms and which closely approximates the experience of face-to-face collaboration, while liberating the participants from the limitations of time and distance.

Claims

1. A networked multimedia system comprising:

A) one or more workstations, each including

i) video and audio reproduction capabilities, and

ii) video and audio capture capabilities;

B) at least one storage cell configured to

i) store audio/video signals; and

C) at least one signal path,

i) interconnecting the one or more workstations and the at least one storage cell,

wherein the system is configured to

D) mark the captured audio/video signals,

i) such that the marked audio/video signals

ii) can later be searched

iii) to access a selected portion thereof; and

E) search the marked audio/video signals

i) in the at least one storage cell to access the selected portion.

2. The networked multimedia system according to claim 1, further comprising

F) a studio editing system for marking the audio/video signals.

3. The networked multimedia system according to claim 1, further comprising

F) a teleconference editing system for marking the audio/video signals.

4. The networked multimedia system according to claim 1, wherein the audio/video signals are

D1) marked by adding tags thereto;

and

E1) searched according to the tags.

5. The networked multimedia system according to claim 1, wherein the audio/video signals are

D1) marked by highlighting selected portions thereof, and

E1) searched according to the highlighted portions.

6. The networked multimedia system according to claim 1, wherein

E1) the search is based on a portion of content selected from the group consisting at least one of audio, video, image, text, graphics, links, references, and recorded snapshots.

7. The networked multimedia system according to claim 1, wherein

E1) the search is inter-file.

8. The networked multimedia system according to claim 1, wherein

E1) the system goes to the selected portion directly without retrieving the audio/video signals searched.

9. The networked multimedia system according to claim 1, wherein the system is further configured to

F) generate a sequence of graphics rendering events

i) associated with computer generated text, images and/or overlay graphics at a workstation, and

G) save the generated sequence.

10. The networked multimedia system according to claim 9, wherein

F1) the generated sequence of graphics rendering events

i) can be played back to render computer generated images and/or overlay graphics

(a) at a workstation,

(b) together with a workstation-user related audio and video

(c) in a determinable temporal relationship, and

G1) the system can

i) save information about the event sequence

(a) related to the displayed computer generated and/or overlay graphics images and/or the audio and video

ii) such that the event sequence can later be reproduced

(a) at a workstation

(b) in the determined temporal relationship.

11. The networked multimedia system according to claim 10, wherein

D1) the audio/video signals are marked along with the sequence of graphics rendering events.

12. The networked multimedia system according to claim 11, wherein

E1) the search is based on the sequence of graphics rendering events.

13. The networked multimedia system according to claim 12, wherein

E1) the search is based on a time code of the audio/video signals.

14. The networked multimedia system according to claim 12, wherein

E1) the search is based on time stamp of the audio/video signals.

15. The networked multimedia system according to claim 12, wherein

E1) the search is based on a frame number of the audio/video signals.

16. The networked multimedia system according to claim 1, wherein

E1) the search is based on events exchanged between a user and application programs of the system.

17. A method for providing networked multimedia collaboration, said method comprising:

A) capturing audio and video signals at

i) one or more workstations;

B) marking the captured audio/video signals

i) such that the marked audio/video signals

ii) can later be searched

iii) to access a selected portion;

C) storing the marked audio/video signals within at least one storage cell;

D) searching the stored audio/video signals for a selected portion; and

E) displaying the selected portion.

18. The method according to claim 17, wherein

B1) said marking is performed using a studio editing system.

19. The method according to claim 17, wherein

B1) said marking is performed using a teleconference editing system.

20. The method according to claim 17, wherein the audio/video signals are

B1) marked by adding tags thereto;

and

D1) searched according to the tags.

21. The method according to claim 17, wherein the audio/video signals are

B1) marked by highlighting selected portions thereof;

and

D1) searched according to the highlighted portions.

22. The method according to claim 17, wherein

D1) the search is based on a portion of content selected from the group consisting at least one of audio, video, image, text, graphics, links, references, and recorded snapshots.

23. The method according to claim 17, wherein

D1) the search is inter-file.

24. The method according to claim 17, wherein

D1) the system goes to the selected portion directly without retrieving the audio/video signals searched.

25. The method according to claim 17, further comprising:

F) generating a sequence of graphics rendering events

i) associated with computer generated text, images and/or overlay graphics at a workstation, and

G) saving the generated sequence.

26. The method according to claim 25, wherein

F1) the generated sequence of graphics rendering events

i) can be played back to render computer generated images and/or overlay graphics

(a) at a workstation,

(b) together with a workstation-user related audio and video

(c) in a determinable temporal relationship, and

G1) the information about the event sequence is saved

i) related to the displayed computer generated and/or overlay graphics images and/or the audio and video

ii) such that the event sequence can later be reproduced

a) at a workstation

b) in a determined temporal relationship.

27. The method according to claim 26, wherein

B1) the audio/video signals are marked along with the sequence of graphics rendering events.

28. The method according to claim 27, wherein

D1) the search is based on the sequence of graphics rendering events.

29. The method according to claim 28, wherein

D1) the search is based on a time code of the audio/video signal.

30. The method according to claim 28, wherein

D1) the search is based on a time stamp in the audio/video signal.

31. The method according to claim 30, wherein

D1) the search is based on a frame number of the audio/video signal.

32. The method according to claim 17, wherein

D1) the search is based on events exchanged between a user and application programs of the system.