Digital camera with interactive printer

• US 6,831,682 B1
• Filed: 06/30/2000
• Issued: 12/14/2004
• Est. Priority Date: 06/30/1999
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Lapstun, Paul, King, Tobin Allen, Walmsley, Simon Robert, Silverbrook, Kia
• Primary Examiner(s): Christensen, Andrew
• Assistant Examiner(s): TRAN, NHAN T
• Application Number:
  US09/608,920
• Time in Patent Office: 1,628 Days
• Field of Search: 348/207.2, 348/207.1, 358/1.1, 345/179
• US Class Current: 348/207.2
• CPC Class Codes: B41J 13/103 for the sheet feeding section
• CPC Class Codes: B41J 13/106 for the sheet output section
• CPC Class Codes: B41J 2/17503 Ink cartridges
• CPC Class Codes: B41J 2/17513 Inner structure
• CPC Class Codes: B41J 2/17523 Ink connection
• CPC Class Codes: B41J 2/17546 electronically
• CPC Class Codes: B41J 2/17553 Outer structure
• CPC Class Codes: B41J 2/17556 Means for regulating the pressure in the cartridge
• CPC Class Codes: B41J 2/17563 Ink filters
• CPC Class Codes: B41J 2/2114 Ejecting transparent or white coloured liquids, e.g. processing liquids B41J2/211 takes precedence
• CPC Class Codes: B42C 19/02 starting with single sheets
• CPC Class Codes: B42C 9/0006 by applying adhesive to a stack of sheets
• CPC Class Codes: B42C 9/0081 applying adhesive to individual sheets for binding them together by fusing, welding B42C9/0093
• CPC Class Codes: B42P 2261/04 Producing books by printing sheets in following order, e.g. for ordering via the Internet
• CPC Class Codes: B65H 29/34 from supports slid from under the articles
• CPC Class Codes: B65H 37/04 for securing together articles or webs, e.g. by adhesive, stitching or stapling adhering replacement to expiring web during change of web roll B65H19/18
• CPC Class Codes: G06F 16/3323 using document space presentation or visualization, e.g. category, hierarchy or range presentation and selection
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06K 17/00 : Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
• CPC Class Codes: G06Q 20/042 : characterized in that the payment protocol involves at least one cheque
• CPC Class Codes: G06Q 30/0248 : Avoiding fraud
• CPC Class Codes: G06Q 30/0283 : Price estimation or determination
• CPC Class Codes: G06Q 30/0601 : Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 40/00 : Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: G06Q 40/04 : Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: G06Q 40/06 : Asset management; Financial planning or analysis
• CPC Class Codes: G06Q 50/188 : Electronic negotiation
• CPC Class Codes: G06V 30/1423 : the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G09B 7/00 : Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F
• CPC Class Codes: H04N 1/00127 : Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00204 : with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/00244 : with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00326 : with a data reading, recognizing or recording apparatus, e.g. with a bar-code apparatus arrangements for the associated working of recording or reproducing apparatus with related apparatus G11B31/00
• CPC Class Codes: H04N 1/00334 : with an apparatus processing barcodes or the like arrangements for sensing record carriers G06K7/00
• CPC Class Codes: H04N 1/00342 : with a radio frequency tag transmitter or receiver storage of additional information in an RFID tag attached to an image bearing paper sheet H04N1/32138
• CPC Class Codes: H04N 1/00358 : Type of the scanned marks
• CPC Class Codes: H04N 1/00376 : Means for identifying a mark sheet or area
• CPC Class Codes: H04N 1/00567 : Handling of original or reproduction media, e.g. cutting, separating, stacking
• CPC Class Codes: H04N 1/00968 : by scanning marks on a sheet mark-sheet input means H04N1/00355; sensing record carriers G06K7/00
• CPC Class Codes: H04N 1/32101 : Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 1/32122 : in a separate device, e.g. in a memory or on a display separate from image data
• CPC Class Codes: H04N 1/32128 : attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 1/32771 : in response to a request, e.g. for a particular document
• CPC Class Codes: H04N 1/32778 : using a mark-sheet or machine-readable code request
• CPC Class Codes: H04N 2201/0082 : Image hardcopy reproducer H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/3243 : of type information, e.g. handwritten or text document
• CPC Class Codes: H04N 2201/3247 : Data linking a set of images to one another, e.g. sequence, burst or continuous capture mode
• CPC Class Codes: H04N 2201/3249 : data relating to a linked page or object, e.g. hyperlink
• CPC Class Codes: H04N 2201/3269 : of machine readable codes or marks, e.g. bar codes or glyphs
• CPC Class Codes: H04N 2201/327 : which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: Y10S 707/915 : Image
• CPC Class Codes: Y10S 707/917 : Text
• CPC Class Codes: Y10S 707/99932 : Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 : Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 : Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 : Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99942 : Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99945 : Object-oriented database structure processing

Abstract

A camera for capturing an image and printing a first interface onto a first surface, in response to a user input, and for printing a second interface onto a second surface, in response to first indicating data received from a sensing device in the form of a stylus. The first indicating data is sensed by the stylus from first coded data. The first interface includes the first coded data. The camera includes a camera module, an input module and a printing module. The camera module inclues an image sensor. The camera module is configured to receive a user input, and, in response to the user input, capture the image via the image sensor. The input module is configured to receive the first indicating data from the stylus, the first indicating data being at least partially indicative of response data. The input module generates second indicating data based on the first indicating data, the second indicating data being at least partially indicative of the response data. The second indicating data is sent to a computer system. The printing module includes a printing mechanism. The printing module is configured to receive the image from the camera module and print the first interface onto the first surface using the printing mechanism. The first interface is based at least partly on the image. The printing module is also configured to receive the response data from the computer system and print the second interface onto the second surface using the printing mechanism. The second interface is based at least partially on the response data.

Claims

1. A camera for capturing an image and printing a first interface onto a first surface, in response to a user input, and for printing a second interface onto a second surface, in response to first indicating data received from a sensing device, the first indicating data being sensed by the sensing device from first coded data, the first interface including the first coded data, the camera including:

(a) a camera module, including an image sensor, configured to;

(i) receive a user input; and

(ii) capture, via the image sensor and in response to the user input, the image;

(b) an input module configured to;

(i) receive, from the sensing device, the first indicating data, the first indicating data being at least partially indicative of response data;

(ii) generate second indicating data based on the first indicating data, the second indicating data being at least partially indicative of the response data;

(iii) send the second indicating data to a computer system; and

(c) a printing module, including a printing mechanism, configured to;

(i) receive, from the camera module, the image;

(ii) generate the first interface based at least partially on the image;

(iii) print the first interface onto the first surface using the printing mechanism;

(iv) receive the response data from the computer system;

(v) generate the second interface based at least partially on the response data; and

(vi) print the second interface onto the second surface using the printing mechanism.

2. A camera according to claim 1, the second interface including second coded data, wherein the printing module includes a coded data generator configured to generate the second coded data based on at least part of the response data.

3. A camera according to claim 2, the response data including second region identity data indicative of at least one identity, the identity being associated with a region of the second interface, the coded data generator being configured to generate the second coded data based on the second region identity data, the second coded data being indicative of the identity.

4. A camera according to any one of the preceding claims, wherein the second interface includes visible information in addition to the second coded data, the visible information being based at least partially on the response data.

5. A camera according to claim 3, wherein the second coded data is also indicative of at least one reference point of the region.

6. A camera according to claim 5, wherein the at least one reference point is determined on the basis of a coded data layout.

7. A camera according to claim 6, wherein the printing module is configured to receive the coded data layout from the computer system.

8. A camera according to claim 6, further including storage means for storing a plurality of the coded data layouts, the printing module being configured to:

receive, from the computer system, layout selection information indicative of one of the coded data layouts; and

use the layout selection information to select one of the stored coded layouts for use in determining the at least one reference point.

9. A camera according to claim 1, wherein the first indicating data includes location data sensed by the sensing device from the first coded data.

10. A camera according to claim 1, wherein the first indicating data includes first region identity data sensed by the sensing device from the first coded data, the first region identity data being indicative of an identity associated with a region of the first interface, the region being at least partially indicative of the response data.

11. A camera according to claim 10, wherein the first indicating data includes location data sensed by the sensing device from the first coded data, the location data being indicative of a location within the region, the location within the region being at least partially indicative of the response data.

12. A camera according to any one of claims 1 to 3 or 5 to 11, wherein the second coded data includes at least one tag, each tag being indicative of the identity of the region.

13. A camera according to claim 12, wherein the second coded data includes a plurality of the tags, the coded data generator being configured to ascertain a position of each tag prior to printing, the respective positions being determined on the basis of a coded data layout.

14. A camera according to claim 13, wherein the coded data generator is configured to receive the coded data layout from the computer device prior to printing the second coded data.

15. A camera according to claim 7, further including storage means for storing a plurality of the coded data layouts, the coded data generator being configured to:

receive, from the computer device, layout selection information indicative of one of the coded data layouts; and

generate the second coded data based on the layout selection information.

16. A camera according to claim 13, wherein each of the tags includes:

first identity data defining a relative position of that tag; and

second identity data identifying the surface.

17. A camera according to any one of claims 1 to 3 or 5 to 11, the camera being configured to print the second interface onto the second surface on demand.

18. A camera according to any one of claims 1 to 3 or 5 to 11, wherein the second interface is printed over a plurality of the pages.

19. A camera according to claim 1, wherein the first and/or second surfaces are defined by a substrate.

20. A camera according to claim 19, wherein the substrate is laminar.

21. A camera according to claim 12, wherein the tags are disposed at predetermined positions on the second surface.

22. A camera according to claim 21, wherein the tags are disposed on the surface within a tessellated pattern comprising a plurality of tiles, each of the tiles containing a plurality of the tags.

23. A camera according to claim 22, wherein the tiles interlock with each other to substantially cover the surface.

24. A camera according to claim 23, wherein the tiles are all of a similar shape.

25. A camera according to claim 24, wherein the tiles are triangular, square, rectangular or hexagonal.

26. A camera according to claim 22, wherein the tags are disposed stochastically within each of the tiles.

27. A camera according to claim 12, wherein each of the tags includes at least one common feature in addition to the second identity data.

28. A camera according to claim 27, wherein at least one common feature is configured to assist finding and/or recognition of the tags by associated tag reading apparatus.

29. A camera according to claim 27, wherein the at least one common feature is represented in a format incorporating redundancy of information.

30. A camera according to claim 29, wherein the at least one common feature is rotationally symmetric so as to be rotationally invariant.

31. A camera according to claim 29, wherein the at least one common feature is ring-shaped.

32. A camera according to claim 12, wherein each of the tags includes at least one orientation feature for enabling a rotational orientation of the tag to be ascertained by associated tag reading apparatus.

33. A camera according to claim 32, wherein the at least one orientation feature is represented in a format incorporating redundancy of information.

34. A camera according to claim 33, wherein the at least one orientation feature is rotationally asymmetric.

35. A camera according to claim 33, wherein the at least one orientation feature is skewed along its major axis.

36. A camera according to claim 12, wherein each of the tags includes at least one perspective feature for enabling a perspective distortion of the tag to be ascertained by associated tag reading apparatus.

37. A camera according to claim 36, wherein the at least one perspective feature includes at least four sub-features which are not coincident.

38. A camera according to claim 12, wherein each tag includes a plurality of tag elements, the first and second identity data each being defined by a plurality of the elements.

39. A camera according to claim 38, wherein the tag elements are disposed in one or more arcuate bands around a central region of each tag.

40. A camera according to claim 39, wherein there are a plurality of the arcuate bands disposed concentrically with respect to each other.

41. A camera according to claim 40, wherein each element takes the form of a dot having a plurality of possible values.

42. A camera according to claim 41, wherein the number of possible values is two.

43. A camera according to claim 41, wherein when representing one of the possible values, the tag elements absorb, reflect or fluoresce electromagnetic radiation of a predetermined wavelength or range of wavelergths to a predetermined greater or lesser extent than the second surface.

44. A camera according to claim 41, wherein the possible values of the tag elements are defined by different relative absorption, reflection or fluorescence of electromagnetic radiation of a predetermined wavelength or range of wavelengths.

45. A camera according to claim 41, wherein the tags are not substantially visible to an average unaided human eye under daylight or ambient lighting conditions.

46. A camera according to claim 41, wherein the tags are slightly visible to an average unaided human eye under daylight or ambient lighting conditions.

47. A camera according to claim 38, wherein the tags are visible to an average unaided human eye under daylight or ambient lighting conditions.

48. A camera according to claim 13, wherein the first identity data is represented in a format incorporating redundancy of information.

49. A camera according to claim 13, wherein the second identity data is represented in a format incorporating redundancy of information.

50. A camera according to claim 49, wherein the printing mechanism is an ink printing mechanism.

51. A camera according to claim 50, wherein the tags are printed using ink that is absorbent or reflective in the ultraviolet spectrum or the infrared spectrum.

52. A camera according to claim 51, wherein the printing mechanism includes a separate ink channel for printing the tags.

53. A camera according to claim 50, wherein the printing module is configured to print the second coded data and additional information substantially simultaneously onto the second surface.

54. A camera according to claim 53, wherein the additional information is printed onto the second surface using colored or monochrome inks.

55. A camera according to claim 54, wherein the additional information is printed onto the second surface using one of the following combinations of colored inks:

CMY;

CMYK;

CMYRGB; and

spot color.

56. A camera according to any one of claims 9 to 11, wherein at least a plurality of the tags are disposed stochastically upon the second surface.

57. A camera according to any one of claims 9 to 11, wherein the tags are disposed in a regular array on the second surface, in accordance with the coded layout data.

58. A camera according to claim 57, wherein the array is triangular.

59. A camera according to claim 57, wherein the array is rectangular.

60. A camera according to claim 57, wherein the tags are tiled over the second surface.

61. A camera according to claim 18, further including a binding mechanism for binding the pages into a bound document.

62. A camera according to claim 53, wherein the second surface is defined by a face of a page, the printing module further including dual printing mechanisms for printing opposite faces of the page simultaneously.

63. A camera according to any one of claims 1 to 3 or 5 to 11, wherein the printing mechanism includes an inkjet printhead for printing ink onto the second surface.

64. A camera according to claim 63, wherein the printhead is a drop on demand inkjet printhead.

65. A camera according to claim 64, wherein the printhead is a pagewidth printhead.

66. A camera according to claim 65, wherein the printhead is configured to deliver a plurality of ink colors onto the second surface with one printing pass.

67. A camera according to claim 65, wherein the printhead includes electro-thermal bend actuators to eject the ink onto the surface.

68. A camera according to any one of claims 67, wherein the printing module includes two sets of printheads, configured to print opposite surfaces of a page substantially simultaneously.

69. A camera according to claim 67, including a forced filtered air delivery mechanism for keeping nozzles of the printhead relatively free of paper dust.

70. A camera according to claim 67, wherein the printhead includes moving nozzle chambers.

71. A camera according to claim 70, wherein the printing module includes two sets of printheads, configured to print opposite surfaces of a page substantially simultaneously.

72. A camera according to claim 1, wherein the first indicating data includes user identity data, the user identity data being indicative of user data.

73. A camera according to claim 72, wherein the user identity data is supplied from storage means associated with the sensing device.

74. A camera according to any one of claims 1 to 3, 5 to 11, 15 or 16, wherein the first interface surface is on the camera.