Methods and systems for object identification and interaction

• US 7,156,289 B2
• Filed: 04/09/2003
• Issued: 01/02/2007
• Est. Priority Date: 10/25/2002
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Silverbrook, Kia, Lapstun, Paul, Walmsley, Simon Robert
• Primary Examiner(s): Nguyen, Kimberly D.
• Application Number:
  US10/409,876
• Publication Number:
  US 20040083138A1
• Time in Patent Office: 1,364 Days
• Field of Search: 235/375, 235/381, 235/383, 235/385, 705/23, 705/10, 705/14, 705/17, 345/179, 345/175, 345/166, 345/574, 178/18.09, 178 1901- 1905
• US Class Current: 235/375
• CPC Class Codes: G06K 19/06009 with optically detectable marking G06K19/063, G06K19/08 take precedence
• CPC Class Codes: G06K 19/06075 the marking containing means for error correction
• CPC Class Codes: G06K 19/06168 the marking being a concentric barcode
• CPC Class Codes: G06K 2019/06243 concentric-code
• CPC Class Codes: G06K 7/14 using light without selection of wavelength, e.g. sensing reflected white light G06K7/10831 - G06K7/1097 take precedence
• CPC Class Codes: G06K 7/1421 Circular bar codes
• CPC Class Codes: G06K 7/1456 determining the orientation of the optical code with respect to the reader and correcting therefore
• CPC Class Codes: G06K 7/1473 error correction

Abstract

A method of facilitating an interaction between a user and a product item, the product item having an identity and the method including a number of steps. The first step involves providing the user with an interface surface associated with the product item and containing information relating to the product item. The interface surface includes coded data indicative of the identity of the product item and of a number of reference points of the interface surface. The next step involves receiving, in a computer system, indicating data from a sensing device regarding the identity of the product item and a position of the sensing device relative to the interface surface. The sensing device, when placed in an operative position relative to the interface surface, sensing the coded data in the vicinity of the sensing device and generating the indicating data using the sensed coded data. The next step involves facilitating, in the computer system and with reference to the indicating data, the interaction between the user and the product item.

Claims

1. A method of facilitating an interaction between a user and a product item, the product item having an identity and the method including the steps of:

providing the user with an interface surface associated with the product item and containing information relating to the product item, the interface surface having disposed thereon coded data indicative of the identity of the product item and of coordinates of a plurality of locations of the interface surface;

receiving, in a computer system, indicating data from a sensing device regarding the identity of the product item and a position of the sensing device relative to the interface surface, the sensing device, when placed in an operative position relative to the interface surface, sensing at least some of the coded data in the vicinity of the sensing device and generating the indicating data using at least some of the sensed coded data; and

facilitating, in the computer system, the interaction between the user and the product item using at least some of the indicating data,

wherein said interaction is selected from the group comprising;

(a) recording a purchase transaction relating to the product item;

(b) recording a potential purchase transaction relating to the product item;

(c) providing comparison information to the user, the comparison information comparing the product information about the product item with product information about another product item;

(d) playing a game associated with the product item; and

(e) conducting a competition in relation to the product item,

and said product information comprises information relating to any one of the product item'"'"'s;

(i) cost;

(ii) contents;

(iii) weight;

(iv) place of origin;

(v) manufacturer;

(vi) date of manufacture;

(vii) date of packaging;

(viii) use-by date;

(ix) current owner; and

(x) dimensions.

2. The method of claim 1 in which the interaction is associated with at least one zone of the interface surface and in which the method includes identifying, in the computer system and front the zone relative to which the sensing device is located, the interaction.

3. The method of claim 2 which includes:

receiving, in the computer system, data regarding movement of the sensing device relative to the interface surface, the sensing device sensing its movement relative to the interface surface using at least some of the coded data; and

identifying, in the computer system and from the movement being at least partially within the at least one zone, the interaction.

4. The method of claim 1, further comprising the step of:

receiving, in the computer system, user data from a sensing device regarding an identity of the user, the sensing device containing the user data; and

facilitating, in the computer system and with reference to the user data and the indicating data, the personalized interaction between the user and the product item.

5. A method according to any one of claims 1 or 4 wherein the interface surface is selected from the group comprising:

(a) a label;

(b) a package; and

(c) a surface of the product item itself.

6. A method according to any one of claims 1 or 4 wherein the coded data is substantially invisible to the average unaided human.

7. A method according to any one of claims 1 or 4 wherein the coded data is disposed over a substantial portion of the interface surface.

8. A method according to claim 7 wherein the coded data is disposed over more than 20% of the interface surface.

9. A method according to claim 7 wherein the coded data is disposed over more than 90% of the interface surface.

10. The method of any one of claims 1 or 4 wherein the method further comprises identifying, in the computer system, that the user has entered handwritten text data by means of the sensing device and effecting, in the computer system, an operation associated with the handwritten text data.

11. The method of claim 10 which includes converting, in the computer system, the handwritten text data to computer text.

12. The method of any one of claims 1 or 4 wherein the method further comprises identifying, in the computer system, that the user has entered a handwritten signature by means of the sensing device and effecting, in the computer system, an operation associated with the handwritten signature.

13. The method of claim 12 which includes verifying, in the computer system, that the signature is that of the user.

14. The method of claim 12 in which the operation associated with the handwritten signature is associated with payment authorization.

15. The method of any one of claims 1 or 4 wherein the method further comprises identifying, in the computer system, that the user has entered a hand-drawn picture by means of the sensing device and effecting, in the computer system, an operation associated with the hand-drawn picture.

16. The method of any one of claims 1 or 4 in which:

a portion of the coded data is superimposed with a visual graphic, the visual graphic being at least partially indicative, to the user, of the interaction.

17. The method of claim 1 in which the sensing device contains an identifier which imparts a unique identity to the sensing device and identifies it as belonging to the user and in which the method includes monitoring, in the computer system, the identifier.

18. The method of any one of claims 1 or 4 which includes providing all required information relating to the interaction in the interface surface to eliminate the need for a separate display device.

19. The method of any one of claims 1 or 4 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout encoding an orientation codeword comprising a sequence of an integer multiple m of n symbols, where m is one or more, each encoded symbol being distributed at n locations about a center of rotational symmetry of the layout such that decoding the symbols at each of the n orientations of the layout produces n representations of the orientation codeword, each representation comprising a different cyclic shift of the orientation codeword and being indicative of the degree of rotation of the layout, and wherein the orientation codeword is fault tolerant.

20. The method of any one of claims 1 or 4 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order a rotational symmetry, where n is at least two, the layout including n identical sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each sub-layout including rotation-indicating data that distinguishes the rotation of that sub-layout from the rotation of at least one other sub-layout within the layout.

21. The method of any one of claims 1 or 4 wherein the coded data is disposed on the interface surface in accordance with a layout having n-fold rotational symmetry, where n is at least two, the layout including n identical first sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each first sub-layout including rotation-indicating data that distinguishes the rotation of that first sub-layout from the rotation of at least one other first sub-layout within the layout.

22. A system for facilitating an interaction between a user and a product item, the product item having an identity and the system including:

a interface surface associated with the product item and containing information relating to the product item, the interface surface having disposed thereon coded data indicative of the identity of the product item and of coordinates of a plurality of locations of the interface surface; and

a computer system adapted to facilitate the interaction in response to receiving indicating data from a sensing device, the indicating data being indicative of the identity of the product item and of a position of the sensing device relative to the interface surface, the sensing device, when placed in an operative position relative to the interface surface, sensing at least some of the coded data in the vicinity of to sensing device and generating the indicating data using at least some of the sensed coded data,

wherein said interaction is selected from the group comprising;

(a) recording a purchase transaction relating to the product item;

(b) recording a potential purchase transaction relating to the product item;

(c) providing comparison information to the user, the comparison information comparing the product information about the product item with product information about another product item;

(d) playing a game associated with the product item; and

(e) conducting a competition in relation to the product item,

and said product information comprises information relating to any one of the product item'"'"'s;

(i) cost;

(ii) contents;

(iii) weight;

(iv) place of origin;

(v) manufacturer;

(vi) date of manufacture;

(vii) date of packaging;

(viii) use-by date;

(ix) current owner; and

(x) dimensions.

23. The system of claim 22 in which the interaction is associated with at least one zone of the interface surface.

24. The system of claim 22 which includes the sensing device, the sensing device sensing its movement relative to the interface surface using at least some of the coded data.

25. The system of claim 22, further wherein:

the computer system is adapted to receive from a sensing device user data regarding an identity of the user, and for facilitating, with reference to the user data and the indicating data, the personalized interaction between the user and the product item, the sensing device containing the user data.

26. The system of any one of claims 22 or 25 wherein the interface surface is selected from the group comprising:

(a) a label;

(b) a package; and

(c) a surface of the product item itself.

27. The system of any one of claims 22 or 25 wherein the coded data is substantially invisible to the average unaided human.

28. The system of any one of claims 22 or 25 wherein the coded data is disposed over a substantial portion of the interface surface.

29. The system of claim 28 wherein the coded data is disposed over more than 20% of the interface surface.

30. The system of claim 28 wherein the coded data is disposed over more than 90% of the interface surface.

31. The system of any one of claims 22 and 25 in which the sensing device includes a marking nib.

32. The system of any one of claims 22 and 25 in which the sensing device contains an identifier which imparts a unique identity to the sensing device and identifies it as belonging to the user.

33. The system of any one of claims 22 or 25 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout encoding an orientation codeword comprising a sequence of an integer multiple m of n symbols, where m is one or more, each encoded symbol being distributed at n locations about a center of rotational symmetry of the layout such that decoding the symbols at each of the n orientations of the layout produces n representations of the orientation codeword, each representation comprising a different cyclic shift of the orientation codeword and being indicative of the degree of rotation of the layout, and wherein the orientation codeword is fault tolerant.

34. The system of any one of claims 22 or 25 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout including a identical sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each sub-layout including rotation-indicating data that distinguishes the rotation of that sub-layout from the rotation of at least one other sub-layout within the layout.

35. The system of any one of claims 22 or 25 wherein the coded data is disposed on the interface surface in accordance with a layout having n-fold rotational symmetry, where n is at least two, the layout including n identical first sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each first sub-layout including rotation-indicating data that distinguishes the rotation of that first sub-layout from the rotation of at least one other first sub-layout within the layout.

36. An interactive product item adapted for interaction with a user via a sensing device and a computer system, and comprising:

a product item having an identity;

receiving, in a computer system, indicating data from a sensing device regarding the identity of the product item and a position of the sensing device relative to the interface surface, the sensing device, when placed in an operative position relative to the interface surface, sensing at least some of the coded data in the vicinity of the sensing device and generating the indicating data using at least some of the sensed coded data;

an interface surface associated with the product item and having disposed thereon information relating to the product item and coded data indicative of the identity of the product item and of coordinates of a plurality of locations on the interface surface, wherein said interaction is selected from the group comprising;

(a) recording a purchase transaction relating to the product item;

(b) recording a potential purchase transaction relating to the product item;

(c) providing comparison information to the user, the comparison information comparing the product information about the product item with product information about another product item;

(d) playing a game associated with the product item; and

(e) conducting a competition in relation to the product item, and said product information comprises information relating to any one of the product item'"'"'s;

(i) cost;

(ii) contents;

(iii)

weight;

(iv) place of origin;

(v) manufacturer;

(vi) date of manufacture;

(vii) date of packaging;

(viii) use-by date;

(ix) current owner; and

(x) dimensions.

37. The interactive product item of claim 36 wherein the coded data is further indicative of a parameter of an interaction.

38. The interactive product item of claim 36 wherein the interface surface is selected from the group comprising:

(a) a label;

(b) a package; and

(c) a surface of the product item itself.

39. The interactive product item of claim 38 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout encoding an orientation codeword comprising a sequence of an integer multiple m of n symbols, where m is one or more, each encoded symbol being distributed at a locations about a center of rotational symmetry of the layout such that decoding the symbols at each of the a orientations of the layout produces n representations of the orientation codeword, each representation comprising a different cyclic shift of the orientation codeword and being indicative of the degree of rotation of the layout, and wherein the orientation codeword is fault tolerant.

40. The interactive product item of claim 38 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout including n identical sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each sub-layout including rotation-indicating data that distinguishes the rotation of that sub-layout from the rotation of at least one other sub-layout within the layout.

41. The interactive product item of claim 38 wherein the coded data is disposed on the interface surface in accordance with a layout having n-fold rotational symmetry, where n is at least two, the layout including n identical first sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each first sub-layout including rotation-indicating data that distinguishes the rotation of that first sub-layout from the rotation of at least one other first sub-layout within the layout.