Annotable document printer

• US 7,551,312 B1
• Filed: 03/17/2005
• Issued: 06/23/2009
• Est. Priority Date: 03/17/2005
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Hull, Jonathan J.
• Primary Examiner(s): Poon; King Y
• Assistant Examiner(s): Washington; Jamares
• Application Number:
  US11/083,902
• Time in Patent Office: 1,559 Days
• Field of Search: 382/1.15, 715/232, 715/230, 715/200, 715/201, 715/202, 715/203, 715/204, 715/221, 715/222, 715/224, 715/246, 715/247, 358/1.15, 358/1.18, 358/1.9, 358/1.6
• US Class Current: 358/1.18
• CPC Class Codes: G06K 15/02 using printers
• CPC Class Codes: G06K 15/181 Receiving print data characterized by its formatting, e.g. particular page description languages
• CPC Class Codes: H04N 1/107 with manual scanning
• CPC Class Codes: H04N 1/32128 attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 2201/3245 of image modifying data, e.g. handwritten addenda, highlights or augmented reality information
• CPC Class Codes: H04N 2201/3271 Printing or stamping
• CPC Class Codes: H04N 2201/3277 The additional information being stored in the same storage device as the image data
• CPC Class Codes: H04N 2201/328 Processing of the additional information

Abstract

A printer receives a multimedia document as input and creates two documents as output: a paper version of the multimedia document and a “mapping” file that maps marks on the physical pages onto actions. The mapping table is supplied to an application associated with a pen-capture device that can be attached to the paper version of the multimedia document and used to receive the marks applied to the paper.

Claims

1. A method, comprising:

receiving a multimedia document comprising content in an original layout, the multimedia document comprising data ordered sequentially with respect to time;

reformatting the received multimedia document, the reformatting comprising augmenting the data of the multimedia document in the original layout to add at least one hot zone positioned in an area contained by spatial coordinates representing a distinct time range in the sequentially ordered data, and visually located with respect to a sequence of data from the sequentially ordered data to create a visual correspondence between the at least one hot zone and a corresponding sequence from the sequentially ordered data, thereby producing a reformatted multimedia document in an output layout;

outputting, by a printer, the reformatted multimedia document in the output layout; and

outputting, by the printer, a mapping table describing at least one action associated with the at least one hot zone of the reformatted multimedia document, the at least one action comprising, responsive to receiving pen strokes within the at least one hot zone, writing a representation of the pen strokes to the received multimedia document at the distinct time range corresponding to the at least one hot zone.

2. The method of claim 1, wherein the multimedia document is a video.

3. The method of claim 1, wherein the multimedia document is a printable document.

4. The method of claim 1, further including:

receiving pen strokes made on the reformatted multimedia document; and

interpreting the pen strokes in accordance with the mapping table.

5. The method of claim 4, wherein the pen strokes are made with a pen that creates marks on paper.

6. The method of claim 4, wherein the pen strokes are made with a non-marking stylus.

7. The method of claim 4, further including:

sending an email to a recipient in accordance with the interpreted pen strokes and the mapping table.

8. The method of claim 4, further including:

writing data representing the received pen strokes to a file containing the multimedia document received by the printer, in accordance with the interpreted pen strokes and the mapping table.

9. The method of claim 4, further including:

writing to a file different from a file containing the multimedia document received by the printer, in accordance with the interpreted pen strokes and the mapping table.

10. The method of claim 1, wherein reformatting the received multimedia document further comprises augmenting the data of the received multimedia document to add a second hot zone that allows a user to specify an associated mapping table that comprises instructions for interpreting input from the user in one or more hot zones.

11. The method of claim 1, wherein reformatting the received multimedia document further comprises augmenting the data of the received multimedia document to add a second hot zone that allows a user to control playback of a video player by marking the second hot zone.

12. The method of claim 1, wherein the mapping table includes data representing a plurality of checkboxes, each checkbox corresponding to possible alphanumeric characters in a first position of a document ID and further including data representing which alphanumeric character corresponds to at least one of the plurality of checkboxes.

13. The method of claim 1, wherein the mapping table includes data representing locations of a plurality of control areas, and further including data representing which control areas correspond to which of a plurality of control functions for a video or audio playback machine.

14. The method of claim 1, wherein the mapping table includes data representing locations of a plurality of hot zones, and further including data representing a time window associated with at least one of the plurality of hot zones.

15. The method of claim 1, wherein the mapping table includes data representing locations of a plurality of hot zones, and further including data representing an action associated with at least one of the plurality of hot zones.

16. The method of claim 1, wherein the mapping table includes data representing locations of a plurality of hot zones, and further including data representing a timing value associated with at least one of the plurality of hot zones.

17. The method of claim 1, wherein the mapping table includes data representing locations of a plurality of hot zones, and further including an action and a destination for the action associated with at least one of the plurality of hot zones.

18. The method of claim 1, further including:

receiving the pen strokes made on the reformatted multimedia document;

interpreting the pen strokes in accordance with the mapping table; and

writing data representing the received pen strokes to a file containing the multimedia document received by the printer in accordance with the interpreted pen strokes and the mapping table, wherein the file is a video file and wherein the writing step is performed at a time when the video file is not being played back.

19. The method of claim 1, further including:

scanning the pen strokes made on the reformatted multimedia document;

interpreting the pen strokes in accordance with the mapping table; and

writing data representing the scanned pen strokes to a video file in accordance with the interpreted pen strokes and the mapping table, wherein the writing step is performed at a time when the video file is not being played back.

32. The method of claim 1, wherein writing the representation of the pen strokes to the received multimedia document comprises:

determining a point in the at least one hot zone where the received pen strokes cross a boundary of the at least one hot zone;

determining a temporal location in the multimedia document corresponding to the crossed point; and

writing the representation of the received pen strokes at the determined temporal location in the multimedia document.

33. The method of claim 1 wherein the at least one action further comprises responsive to receiving pen strokes within the at least one hot zone, writing a representation of the pen strokes to an electronic message.

34. The method of claim 1 wherein the at least one action further comprises responsive to receiving pen strokes within the at least one hot zone, displaying a representation of the pen strokes on a screen.

20. A method, comprising:

receiving a document file comprising multimedia data ordered sequentially with respect to time and a plurality of designated timeline input areas contained by spatial coordinates and capable of receiving pen strokes, each designated timeline input area corresponding to a plurality of distinct key multimedia frames in multimedia data, and spatial coordinates of each designated timeline input area representing a distinct time range corresponding to the plurality of distinct key frames of the received document file, and visually located with respect to the corresponding plurality of distinct key frames to create a visual correspondence between each of the designated timeline input area and the corresponding plurality of distinct key frames;

receiving pen strokes within one of the plurality of designated timeline input areas of the document, the one of the plurality of designated timeline input areas associated via a mapping table with an action comprising, responsive to receiving pen strokes within the one of the plurality of designated timeline input area, writing a representation of the pen strokes to the received multimedia document at distinct time range corresponding to the one of the plurality of designated timeline input area;

determining pen strokes spatial coordinates of the pen strokes within one of plurality of the designated timeline input areas;

linearly scaling the pen strokes spatial coordinates to a corresponding time offset in the multimedia data; and

writing to the file, at the corresponding time offset, data representing the pen strokes.

31. The method of claim 20, wherein linearly scaling the spatial coordinates to a corresponding time offset in the multimedia data is performed based at least in part on a size of the input area.

21. A system, comprising:

a printer that;

receives a multimedia document comprising content ordered sequentially with respect to time and in an original layout,

reformats the received multimedia document by augmenting the content of the multimedia document in the original layout to add at least one hot zone positioned in an area contained by spatial coordinates representing a distinct time range in the sequentially ordered content, and visually located with respect to a sequence of content from the sequentially ordered content to create a visual correspondence between the at least one hot zone and the corresponding sequence of content, thereby producing a reformatted multimedia document in an output layout, and

outputs the reformatted multimedia document in the output layout; and

a data storage medium containing a mapping table that describes at least one action associated with the at least one hot zone of the reformatted multimedia document, the at least one action comprising, responsive to receiving pen strokes within the at least one hot zone, writing a representation of the pen strokes to the received multimedia document at the distinct time range corresponding to the at least one hot zone.

22. The system of claim 21, wherein the multimedia document is a video.

23. The system of claim 21, wherein the multimedia document is a printable document.

24. The system of claim 21, further including:

a device to receive pen strokes made on the reformatted multimedia document; and

a device to interpret the pen strokes in accordance with the mapping table.

25. A computer program product including a computer readable medium comprising executable instructions thereon, the instructions capable of causing a data processing system to:

receive a multimedia document comprising content in an original layout, the multimedia document comprising data ordered sequentially with respect to time;

reformat the received multimedia document, the reformatting comprising augmenting the content of the multimedia document in the original layout to add at least one hot zone positioned in an area contained by spatial coordinates representing a distinct time range in the sequentially ordered data, and visually located with respect to a sequence of data from the sequentially ordered data to create a visual correspondence between the at least one hot zone and the corresponding sequence of data, thereby producing a reformatted multimedia document in an output layout;

output, by the a printer, the reformatted multimedia document in the output layout; and

output, by printer, a mapping table describing at least one action associated with the at least one hot zone of the reformatted multimedia document, the at least one action comprising, responsive to receiving pen strokes within the at least one hot zone, writing a representation of the pen strokes to the received multimedia document at the distinct time range corresponding to the at least one hot zone.

26. The computer program product of claim 25, wherein the multimedia document is a video.

27. The computer program product of claim 25, wherein the multimedia document is a printable document.

28. A computer readable medium comprising executable instructions thereon, the instructions capable of causing a data processing system to:

receive a document file comprising multimedia data ordered sequentially with respect to time and a plurality of designated timeline input areas contained by spatial coordinates and capable of receiving pen strokes, each designated timeline input area corresponding to a plurality of distinct key multimedia frames in multimedia data, and spatial coordinates of each designated timeline input area representing a distinct time range corresponding to the plurality of distinct key frames of the received document file, and visually located with respect to the corresponding plurality of distinct key frames to create a visual correspondence between each of the designated timeline input area and the corresponding plurality of distinct key frames;

receive pen strokes within a one of the plurality of designated timeline input areas of the document, the one of the plurality of designated timeline input areas associated via a mapping table with an action comprising, responsive to receiving pen strokes within the one of the plurality of designated timeline input area, writing a representation of the pen strokes to the received multimedia document at distinct time range corresponding to the one of the plurality of designated timeline input area;

determine pen strokes spatial coordinates of the pen strokes within one of plurality of the designated timeline input areas;

linearly scale the spatial coordinates to a corresponding time offset in the multimedia data; and

write to the file, at the corresponding time offset, data representing the pen strokes.

29. A method, comprising:

receiving a video file;

reformatting the received video file, thereby producing an output layout, the output layout comprising a plurality of designated timeline input areas, each designated timeline input area contained by spatial coordinates, representing a distinct time range corresponding to a plurality of distinct key frames of the received video file, and visually located with respect to the distinct key frames to create a visual correspondence between the designated timeline input area and the corresponding plurality of distinct key frames;

outputting, by a printer, the reformatted video file in the output layout; and

outputting, by the printer, a mapping table describing at least one action associated with at least one of the plurality of designated timeline input areas of the output layout, the at least one action comprising, responsive to receiving written input within the at least one of the plurality of designated timeline input areas, writing a representation of the written input to the received video file at the distinct time range corresponding to the at least one of the plurality of designated timeline input areas contained by the spatial coordinates.

30. The method of claim 29, wherein the plurality of designated timeline input areas are arranged in sequential order with respect to time values of the corresponding plurality of distinct key frames of the video.