Enhanced input peripheral

• US 7,164,413 B2
• Filed: 08/06/2004
• Issued: 01/16/2007
• Est. Priority Date: 05/19/1999
• Status: Expired due to Fees

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rhoads, Geoffrey B., Davis, Bruce L., Seder, Phillip Andrew
• Primary Examiner(s): Hjerpe; Richard
• Assistant Examiner(s): LESPERANCE, JEAN E
• Application Number:
  US10/914,052
• Publication Number:
  US 20050078088A1
• Time in Patent Office: 893 Days
• Field of Search: 345/156, 345/157, 345/158, 345/163, 345/164, 345/165, 345/166
• US Class Current: 345/163
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G07D 7/0034 using watermarks
• CPC Class Codes: G07F 17/26 for printing, stamping, franking, typing or teleprinting apparatus ticket printing or the like apparatus G07F17/42
• CPC Class Codes: H04N 1/00005 relating to image data
• CPC Class Codes: H04N 1/00037 Detecting, i.e. determining the occurrence of a predetermined state H04N1/00031 takes precedence
• CPC Class Codes: H04N 1/00973 from a remote device, e.g. receiving via the internet instructions input to a computer terminal
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/32229 with selective or adaptive application of the additional information, e.g. in selected regions of the image H04N1/32213 takes precedence
• CPC Class Codes: H04N 2201/3249 data relating to a linked page or object, e.g. hyperlink

Abstract

A mouse having X- and Y-position encoders, and associated circuitry for generating X- and Y-movement data, additionally includes an optical sensor for producing grey-scale image data, thereby allowing the mouse to serve both as a positioning device and an optical input device. Desirably, the substrate on which the optical sensor is formed also includes a steganographic decoder. This decoder can enable a variety of functionality, such as linking to web addresses steganographically encoded in print media (e.g., by subtle inking variations or by texture). In other embodiments, such a peripheral is provided without mouse-like functionality, and again permits reading machine-readable indicia printed in catalogs and the like.

Claims

1. In a mouse having X- and Y- position encoders, and circuitry responsive thereto for generating X- and Y- movement data and providing same to an associated computer, an improvement comprising an optical sensor disposed in said mouse, circuitry responsive thereto for producing grey-scale optical image data and for providing same to the associated computer, and a semiconductor substrate, the substrate having formed thereon both the optical sensor and said circuitry, wherein the mouse serves both as a positioning device and as an optical input device, and wherein said substrate also has formed thereon a second circuit, for decoding plural bit auxiliary data steganographically encoded within said optical image data, and for providing data related thereto to said associated computer.

2. A method of using an optical mouse, the mouse including an optical sensor with several elements, and circuitry coupled thereto for producing grey scale image data, the method comprising:

positioning the mouse over a substrate, the substrate having user-perceptible printing thereon, said printing having plural-bit auxiliary data steganographically encoded therein;

capturing image data corresponding to said printing; and

from said image data, decoding the plural-bit auxiliary data steganographically encoded in said printing.

3. The method of claim 2 in which the substrate includes plural regions, each encoded with a different set of auxiliary data, and a desired set of auxiliary data is decoded by positioning the mouse over a corresponding region.

4. The method of claim 2 in which the substrate is a page in a bound collection of pages, and the method includes positioning the mouse over said page.

5. The method of claim 4 in which the bound collection of pages is a magazine.

6. The method of claim 4 in which the bound collection of pages is a book.

7. The method of claim 2 in which the substrate is a mouse pad.

8. The method of claim 2 in which the mouse is coupled to an associated computer device, and the method includes decoding the plural-bit auxiliary data using a processor in said computer device.

9. A method of using an optical mouse, the mouse including an optical sensor with several elements, and circuitry coupled thereto for producing grey scale image data, the method comprising:

positioning the mouse over a substrate, the substrate having user-perceptible printing thereon, said printing having plural-bit auxiliary data steganographically encoded therein;

capturing image data corresponding to said printing; and

from said image data, decoding the plural-bit auxiliary data steganographically encoded in said printing;

wherein the method further includes;

directing a web browser to a web address identified in accordance with the plural-bit auxiliary data decoded from the image data.

10. A method of using an optical mouse, the mouse including an optical sensor with several elements, and circuitry coupled thereto for producing grey scale image data, the method comprising:

positioning the mouse over a textured substrate, the texturing having plural-bit auxiliary data steganographically encoded therein;

capturing image data corresponding to said texturing; and

from said image data, decoding the plural-bit auxiliary data steganographically encoded in said texturing.

11. A peripheral device for use with a computer system comprising:

a housing adapted to fit within a user'"'"'s palm and slide over a medium;

an optical sensor having plural sensing elements and producing image signals;

a lens for imaging the medium onto the sensor;

circuitry coupled to the sensor and disposed within the housing for processing the signals from the sensor and producing corresponding output data, the circuitry comprising a decoder for discerning steganographically-encoded information represented in said image signals; and

a wireless link for relaying the output data from the peripheral device to the computer system;

wherein said sensor is useful in acquiring optically-encoded multi-bit information from said medium for use by said computer system.

12. The device of claim 11 in which the circuitry within said housing analyzes the image signals and produces multi-bit information corresponding thereto.

13. The device of claim 11 in which the optically encoded information comprises a plural-bit identifier.

14. The device of claim 11 wherein the decoder is operable to extract the steganographically-encoded information by discerning slight changes that have been made to the image signals prior to printing to convey hidden digital data.

15. A system including a device and a computer apparatus comprising:

a housing adapted to fit within a user'"'"'s palm and position over a medium;

an optical sensor having plural sensing elements and producing image signals;

a lens for imaging the medium onto the sensor;

circuitry coupled to the sensor and disposed within the housing for processing signals from the sensor corresponding to a machine-readable indicia comprising artwork that is steganographically encoded to convey multi-bit binary data, and producing corresponding multi-bit binary output data decoded from said indicia; and

transfer means for relaying the output data from the device to the computer apparatus;

wherein said circuitry is integrated on a common substrate with said sensing elements.

16. The system of claim 15 in which the artwork comprises a photograph.

17. The system of claim 15 in which:

the device includes a user interface control; and

the circuitry performs steganographic decoding only when said control is activated by a user.

18. The system of claim 15 in which the multi-bit data is associated with an internet address, and the system includes a display for presenting image data downloaded from said internet address.

19. The system of claim 15 wherein the artwork is steganographically-encoded with the multi-bit binary data by making slight changes to the artwork in digital form to convey hidden digital data in the artwork.

20. A method of interacting with printed material using a peripheral device, the peripheral device providing positional data to an associated computer and including an optical sensing system comprising plural optical sensing elements, the method comprising:

positioning the device over the printed material;

generating optical sensor data from said optical sensing system, said data corresponding to a machine-readable indicia formed on the printed material;

performing a steganographic decoding process on said optical sensor data to produce plural-bit data corresponding to said machine-readable indicia; and

providing said plural-bit data to said computer.

21. The method of claim 20 in which the machine-readable indicia is hidden in artwork.

22. The method of claim 21 in which the artwork comprises a photograph.

23. The method of claim 20 in which the plural-bit data is associated with an internet address, and the method further includes downloading data to said computer from said internet address.

24. The method of claim 20 in which the peripheral device includes a user interface control, and the method includes performing said steganographic decoding process only when said control is activated by a user.

25. The method of claim 24 in which the control is a button.

26. The method of claim 20 in which said steganographic decoding is performed by apparatus within the peripheral.

27. The method of claim 26 in which plural bit data from said decoding is transmitted, by wireless transmission, to an apparatus remote from the peripheral.

28. The method of claim 20 in which at least part of said optical sensor data is transferred from the peripheral, and said steganographic decoding is performed on said data in apparatus remote from said peripheral.

29. The method of claim 28 in which said optical sensor data is transferred from the peripheral to said remote apparatus by wireless transmission.

30. The method of claim 20 wherein plural-bit data is steganographically decoded by discerning slight changes to that have been made to an image to convey hidden plural-bit data in the image.