METHOD OF ASSOCIATING MULTIMEDIA OBJECT WITH PRINTED SUBSTRATE

• US 20100184464A1
• Filed: 03/30/2010
• Published: 07/22/2010
• Est. Priority Date: 12/01/1999
• Status: Abandoned Application

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Silverbrook, Kia, Lapstun, Paul, King, Tobin Allen
• Application Number:
  US12/750,469
• Publication Number:
  US 20100184464A1
• Time in Patent Office: Days
• US Class Current: 455/556.100
• CPC Class Codes: B41J 3/445 Printers integrated in other types of apparatus, e.g. printers integrated in cameras
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1656 Details related to functional adaptations of the enclosure, e.g. to provide protection against EMI, shock, water, or to host detachable peripherals like a mouse or removable expansions units like PCMCIA cards, or to provide access to internal components for maintenance or to removable storage supports like CDs or DVDs, or to mechanically mount accessories mounting of accessories to a computer display G06F1/1607; display hoods G06F1/1603; cooling arrangements for portable computers G06F1/203
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1688 the I/O peripheral being integrated loudspeakers
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: G06Q 40/08 Insurance
• CPC Class Codes: H04M 1/27475 using interactive graphical means or pictorial representations
• CPC Class Codes: H04M 1/2755 by optical scanning
• CPC Class Codes: H04M 1/72409 by interfacing with external accessories hands-free H04M1/60
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72442 for playing music files
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2250/12 : including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04M 3/42 : Systems providing special services or facilities to subscribers specially adapted for wireless communication networks H04W4/00
• CPC Class Codes: H04M 7/0015 : First party call control architectures
• CPC Class Codes: H04N 1/00204 : with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/00244 : with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00307 : with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00326 : with a data reading, recognizing or recording apparatus, e.g. with a bar-code apparatus arrangements for the associated working of recording or reproducing apparatus with related apparatus G11B31/00
• CPC Class Codes: H04N 1/00392 : Other manual input means, e.g. digitisers or writing tablets
• CPC Class Codes: H04N 1/00968 : by scanning marks on a sheet mark-sheet input means H04N1/00355; sensing record carriers G06K7/00
• CPC Class Codes: H04N 1/32122 : in a separate device, e.g. in a memory or on a display separate from image data
• CPC Class Codes: H04N 1/32133 : on the same paper sheet, e.g. a facsimile page header
• CPC Class Codes: H04N 1/32778 : using a mark-sheet or machine-readable code request
• CPC Class Codes: H04N 19/60 : using transform coding
• CPC Class Codes: H04N 19/61 : in combination with predictive coding
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/422 : Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/42203 : sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 : Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/478 : Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 2201/0082 : Image hardcopy reproducer H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/3226 : of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image
• CPC Class Codes: H04N 2201/3247 : Data linking a set of images to one another, e.g. sequence, burst or continuous capture mode
• CPC Class Codes: H04N 2201/3264 : of sound signals
• CPC Class Codes: H04N 2201/3269 : of machine readable codes or marks, e.g. bar codes or glyphs
• CPC Class Codes: H04N 2201/3274 : Storage or retrieval of prestored additional information
• CPC Class Codes: H04N 5/445 : for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 5/76 : Television signal recording
• CPC Class Codes: H04N 5/765 : Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/783 : Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/907 : using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence
• CPC Class Codes: H04N 7/163 : by receiver means only
• CPC Class Codes: Y10S 707/99931 : Database or file accessing
• CPC Class Codes: Y10T 428/187 : Continuous sectional layer

Abstract

A method of associating a multimedia object with a printed substrate using a handheld display device having a touch-sensitive screen and a transceiver for sending and receiving digital information. The printed substrate has a corresponding page description retrievable via a substrate identity. The method comprises the steps of: displaying, on the touch-sensitive screen, display information corresponding to the printed substrate; identifying a multimedia object for association with a zone of the printed substrate; and interacting with the display information to indicate association of the multimedia object with the zone, thereby causing the page description to be updated in accordance with the indicated association. Subsequent interaction with the zone of the printed substrate using the device causes retrieval of the multimedia object from the updated page description.

Claims

1. A method of associating a multimedia object with a printed substrate using a handheld display device having a touch-sensitive screen and a transceiver for sending and receiving digital information, said printed substrate having a corresponding page description stored in a computer system, said method comprising the steps of:

displaying, on said touch-sensitive screen of said device, display information corresponding to at least part of the printed substrate;

identifying a multimedia object for association with a zone of said printed substrate; and

interacting with said display information to indicate association of said multimedia object with said zone, thereby causing the page description to be updated in accordance with the indicated association,

wherein subsequent interaction with said zone of said printed substrate using said device causes retrieval of the multimedia object from said updated page description.

2. The method of claim 1, wherein said display device is a mobile phone or PDA.

3. The method of claim 1, wherein said display device comprises an optical sensor for imaging an area of the printed substrate and generating image data.

4. The method of claim 3, wherein said subsequent interaction comprises the steps of:

imaging the zone of the printed substrate using said optical sensor;

generating interaction data using the image data, said interaction data identifying a substrate identity indexed with the page description and a position of the device relative to the substrate;

retrieving, using the interaction data and the page description, the multimedia object associated with said zone; and

providing, to a user, multimedia based on the retrieved multimedia object.

5. The method of claim 1, further comprising the step of:

capturing said multimedia object using an input device of the handheld display device.

6. The method of claim 5, further comprising the step of:

storing said multimedia object in a memory of the handheld display device.

7. The method of claim 5, wherein said input device comprises a camera for capturing a photo or video.

8. The method of claim 1, wherein said displaying comprises the substeps of:

positioning said device over at least part of the substrate;

imaging an area of the substrate and generating image data using an optical sensor;

determining interaction data using the image data, said interaction data identifying a substrate identity indexed with the page description;

retrieving, using the interaction data and the page description, display data corresponding to at least part of the substrate; and

displaying, on said display screen, the display information based on said display data.

9. The method of claim 8, wherein said interaction data identifies a position of the device relative to the printed substrate.

10. The method of claim 9, wherein said retrieved display data corresponds to a part of the substrate containing said position.

11. The method of claim 1, further comprising the step of:

printing an icon onto said substrate, said icon representing the associated multimedia object.

12. The method of claim 1, wherein said display device comprises a printer for printing said icon.

13. The method of claim 8, wherein said retrieval of said display data comprises the substeps of:

communicating said substrate identity to a server via a wireless network;

receiving the page description corresponding to said substrate identity; and

identifying said display data using the position of the device and the page description.

14. The method of claim 8, wherein said retrieval of said display data comprises the substeps of:

communicating the interaction data to a server via a wireless network; and

receiving said display data based on said interaction data.

15. The method of claim 13, wherein the wireless network is a mobile telephone network accessed using said transceiver.

16. The method of claim 1, wherein said display information is retrieved from a memory in said device, said memory storing the page description corresponding to the substrate.

17. The method of claim 1, wherein said interacting with said display information is via said touch-sensitive screen.

18. The method of claim 1, wherein said multimedia object is displayed on said touch-sensitive screen as an icon.

19. The method of claim 18, wherein said icon is displayed at a location of said display information to indicate association of said multimedia object with said zone of said substrate.

20. The method of claim 1, wherein said printed substrate comprises coded data disposed thereon or therein, said coded data identifying at least one of:

said substrate identity and a plurality of locations on the substrate.