System and method for video access from notes or summaries

• US 7,647,555 B1
• Filed: 04/13/2000
• Issued: 01/12/2010
• Est. Priority Date: 04/13/2000
• Status: Expired due to Fees

• Current Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.), Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.), Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Miyazaki, Jun, Wilcox, Lynn D., Sasaoka, Makoto, Flores, L. Noah, Chiu, Patrick, Hecht, David L.
• Primary Examiner(s): Sax; Steven P
• Application Number:
  US09/548,685
• Time in Patent Office: 3,561 Days
• Field of Search: 345719-723, 345/864, 345/780, 345/806, 345/807, 345730-732, 707/10, 707/200, 386/68, 386/111, 386/125, 398/515, 715719-726, 715738-739, 715771-773, 715/755, 715/800, 715/802, 715/803, 715/804, 715/805, 715/826, 725/37
• US Class Current: 715/721
• CPC Class Codes: G11B 2220/80 Indexing information stored in optical or magnetic or other strip attached to cassette or disc, e.g. barcodes attached to a recording medium
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 5/91 Television signal processing therefor
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal

Abstract

Recorded video is accessed from printed notes or summaries derived from the video. Summaries may be created automatically by analyzing the recorded video, and annotations are made by a user on a device for note-taking with digital ink and video. The notes and/or summaries are printed along with data glyphs that provide time based indexes or offsets into the recorded video. The indexes or offsets are retrieved by scanning the glyph on the printout. The glyph information can be embedded in the printouts in many ways. One method is to associate block glyphs with annotations or images on the printed pages. Another method is to provide an address carpet in an annotated timeline. Yet another method is to provide a two-dimensional address carpet with X-Y position mapped to time which can be used to provide selected access to the video. The accessed video may be played back on the note-taking device on a pen computer, or on a summary interface on a Web browser-type device.

Claims

1. A system for accessing a video data stream, comprising:

an interface having a printout stored on a storage medium, the printout comprising;

at least one object created by a user in connection with the video data stream that corresponds to at least a portion of the video data stream, wherein the video data stream is discernible to the user, and wherein the object is at least one of notes, annotations, clips, and snapshots taken by the user while viewing the video data stream; and

a data glyph associated with each of the at least one object that identifies a portion of the video data stream corresponding to the object, wherein the data glyph is in a data glyph carpet positioned in conjunction with a timeline such that each data glyph in the data glyph carpet references a position in the timeline which also represents an approximate offset into the video data stream, and wherein the object is placed in position corresponding to its corresponding data glyph in the data glyph carpet such that the data glyph is used to access the portion of the video data stream that is associated with the object;

wherein the accessed portion of the video data stream corresponding to the object is initiated playback upon selecting the data glyph from the glyph carpet.

2. The system according to claim 1, wherein the codes are embedded in each corresponding object.

3. The system according to claim 1, wherein the output further comprises a table that correlates each of the codes to an offset in the data stream.

4. The system according to claim 1, wherein the output is a printout.

5. The system according to claim 1, wherein the data stream is a video.

6. The system according to claim 1, wherein the code is a data glyph.

7. The system according to claim 3, wherein the table is a data glyph.

8. A device for accessing video from notes, comprising:

an electronic note-taking device that allows a user to select keyframes and make annotations while viewing a streaming video data stream that is being digitized and stored, the keyframes and annotations being captured and indexed to a position of the data stream related to the note-taking, and then printed in a video index, wherein the video index is embedded with one or more glyph codes that reference an annotation and a position in the data stream corresponding to a time period during which the annotation is made;

a scanning device that scans the glyph codes embedded in the video index;

a computing device that reads the scanned glyph codes and accesses a portion of the data stream wherein the accessed portion corresponds to the position referenced by the glyph codes; and

a display mechanism that initiates playback of the accessed portion of the data stream according to the position referenced by the scanned glyph codes.

9. The device according to claim 8, wherein:

the computing device includes a network connection capable of connecting to any of a wired or wireless network; and

the computing mechanism requests the portion of the data stream from a remote device via the network connection.

10. The device according to claim 9, wherein the computing mechanism includes a table that correlates the glyph codes to an offset into the video.

11. The device according to claim 10, wherein the computing mechanism is further configured to read the table via the scanning device.

12. The device according to claim 8, wherein the computing device comprises a palm type computer and a wireless network connection.

13. The device according to claim 8, wherein the scanning device is integrated into a remote control for auxiliary equipment.

14. The device according to claim 13, wherein the auxiliary equipment is one of a computer, a television, and a Web-TV device.

19. The device of claim 8 wherein the video index is a printed paper interface to access and navigate a video data stream.

20. The device of claim 8 wherein the glyph codes are encoded with a location of video stored on a server and a time offset into the video.

15. A machine readable tangible storage medium having instructions stored thereon, wherein the instructions are executed by a processor such that the execution of said instructions cause the processor to:

receive one or more annotations and a selection of at least one of a plurality of keyframes during a streaming video data stream that is being digitized and stored;

capture the keyframe and the annotations and index said annotations to a position of the video data stream;

generate a glyph code associated with each keyframe that identifies the position of the video data stream corresponding to each keyframe such that the glyph code is used to access the position of the video data stream corresponding to the time period during which selection of the keyframe was made; and

print a video summary, the summary comprising a plurality of keyframes and a plurality of embedded glyph codes, wherein each glyph code references the keyframe corresponding to at least a portion of the video data stream at said time period in the video data stream;

scan the video summary and read the glyph code embedded in said video summary to access the portion of the video data stream, wherein the accessed portion corresponds to the position referenced by the glyph code at said time period in the video data stream; and

initiate playback of the accessed portion of the data stream according to the position referenced by the glyph code.

16. The machine readable medium according to claim 15, wherein the instructions are further configured to cause the system to generate a table that correlates each of the codes to an offset in the data stream.

17. The machine readable medium according to claim 15, further comprising:

a data glyph carpet comprising the glyph codes, wherein

the keyframes are placed in positions corresponding to their corresponding glyph codes in the data glyph carpet.

18. The machine readable medium according to claim 17, wherein the data glyph carpet is positioned in conjunction with a timeline such that the glyph codes in the data glyph carpet correspond to points on the timeline which also represent an approximate offset into the data stream.