Pointing and identification device

• US 20090267895A1
• Filed: 09/23/2005
• Published: 10/29/2009
• Est. Priority Date: 09/23/2005
• Status: Active Grant

• Current Assignee: Ovyrvu LLC
• Original Assignee: Ovyrvu LLC
• Inventors: Bunch, Jesse C.
• Granted Patent: US 8,471,812 B2
• Time in Patent Office: Days
• US Class Current: 345/157
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: G06F 3/042 by opto-electronic means

Abstract

A pointing and identification device (PID) allows the user to point at objects in the real world, on television or movie screens, or otherwise not on the computer screen. The PID includes a digital camera and one or both of a laser and a reticle for aiming the digital camera. An image taken with the digital camera is transmitted to a computer or the like.

Claims

1. A pointing and identification device for pointing at an object, the pointing and identification device comprising:

at least one actuation means for actuation by the user when the user points the pointing and identification device at the object;

a digital camera for forming a digital image of the object or of a portion of the object when the user points the pointing and identification device at the object and actuates the at least one actuation means;

an aiming device for permitting the user to aim the pointing and identification device at the object; and

a communication device for communicating the digital image to a different location when the user actuates the at least one actuation means;

wherein the object is at least one of a spot on a displayed image on a display, a subarea of a space on the displayed image on the display, one of a plurality of objects in the displayed image on the display, an object in space, a spot on or close to an object in space, a subarea of a surface in space, or one of a plurality of objects in space.

2. The pointing and identification device of claim 1, wherein the aiming device comprises a laser.

3. The pointing and identification device of claim 2, wherein the laser is modulated to convey information.

4. The pointing and identification device of claim 3, wherein the information comprises an identity of the pointing and identification device.

5. The pointing and identification device of claim 2, wherein the laser is of variable intensity.

6. The pointing and identification device of claim 2, wherein the laser is one of an infrared laser and an ultraviolet laser.

7. The pointing and identification device of claim 2, wherein the laser is configured to display crosshairs on the object.

8. The pointing and identification device of claim 2, wherein the laser is configured to display an image on the object.

9. The pointing and identification device of claim 2, wherein the aiming device further comprises a reticle.

10. The pointing and identification device of claim 9, wherein the reticle is a fixed reticle.

11. The pointing and identification device of claim 9, wherein the reticle is a movable reticle.

12. The pointing and identification device of claim 1, wherein the aiming device comprises a reticle.

13. The pointing and identification device of claim 12, wherein the reticle is a fixed reticle.

14. The pointing and identification device of claim 12, wherein the reticle is a movable reticle.

15. The pointing and identification device of claim 1, wherein the communication device communicates with the different location wirelessly.

16. The pointing and identification device of claim 15, wherein the communication device communicates with the different location over a wireless networking protocol.

17. The pointing and identification device of claim 15, wherein the communication device communicates with the different location over a cellular telephone protocol.

18. The pointing and identification device of claim 1, further comprising a location/orientation device for determining at least one of a location and an orientation of the pointing and identification device, and wherein the communication device communicates said at least one of the location and orientation to the different location.

19. The pointing and identification device of claim 18, wherein the location/orientation device comprises a GPS receiver.

20. The pointing and identification device of claim 19, wherein the GPS receiver determines the locations of at least two points in the pointing and identification device to determine the orientation of the pointing and identification device.

21. The pointing and identification device of claim 18, wherein the location/orientation device determines a distance of the pointing and identification device from the object.

22. The pointing and identification device of claim 21, wherein the location/orientation device comprises a rangefinder.

23. The pointing and identification device of claim 22, wherein the rangefinder uses the laser.

24. The pointing and identification device of claim 22, wherein the rangefinder uses ultrasound.

25. The pointing and identification device of claim 1, further comprising a gun-shaped housing.

26. The pointing and identification device of claim 25, wherein the at least one actuation means comprises a trigger.

27. The pointing and identification device of claim 1, wherein the at least actuation means comprises:

a click-up button for enlarging an area of the image in which the object is identified; and

a click-down button for shrinking an area of the image in which the object is identified.

28. A pointing and identification system for pointing at an object, the pointing and identification system comprising:

(a) a pointing and identification device comprising;

at least one actuation means for actuation by the user when the user points the pointing and identification device at the object;

a digital camera for forming a digital image of the object or of a portion of the object when the user points the pointing and identification device at the object and actuates the at least one actuation means;

an aiming device for permitting the user to aim the pointing and identification device at the object; and

a communication device for communicating the digital image to a different location when the user actuates the at least one actuation means; and

(b) a receiver at the different location for receiving the digital image from the communication device in the pointing and identification device;

wherein the object is at least one of a spot on a displayed image on a display, a subarea of a space on the displayed image on the display, one of a plurality of objects in the displayed image on the display, an object in space, close to an object in space, a subarea of a surface in space, or one of a plurality of objects in space.

29. The pointing and identification system of claim 28, comprising a plurality of said pointing and identification devices in communication with the receiver.

30. The pointing and identification system of claim 29, wherein, in each of the plurality of pointing and identification devices, the aiming device comprises a laser.

31. The pointing and identification system of claim 30, wherein the laser in each of the plurality of pointing and identification devices is modulated to identify the pointing and identification device.

32. The pointing and identification system of claim 31, wherein the laser in each of the plurality of pointing and identification devices is also modulated to allow communication among the pointing and identification devices.

33. The pointing and identification system of claim 28, further comprising a reference framework, for installation in a space, for detection by the pointing and identification device to permit the pointing and identification device to determine its location and orientation within the space.

34. The pointing and identification system of claim 33, wherein:

the aiming device in the pointing and identification device comprises a laser; and

the reference framework comprises a plurality of retroreflectors.

35. The pointing and identification system of claim 34, wherein the retroreflectors are modulated.

36. The pointing and identification system of claim 35, wherein the pointing and identification device and the modulated retroreflectors are synchronized with a common clock.

37. The pointing and identification system of claim 33, wherein the reference framework comprises a plurality of light emitters.

38. The pointing and identification system of claim 37, wherein the light emitters are modulated.

39. The pointing and identification system of claim 38, wherein the pointing and identification device and the modulated light emitters are synchronized with a common clock.

40. The pointing and identification system of claim 37, wherein the light emitters emit light at different colors.

41. The pointing and identification system of claim 28, wherein the receiver comprises a host adapter for connection to a computing device.

42. The pointing and identification system of claim 28, further comprising a computing device, and wherein the receiver comprises a host adapter connected to the computing device.

43. The pointing and identification system of claim 42, wherein the computing device stores a digital representation of a space in which the pointing and identification device is used.

44. The pointing and identification system of claim 42, wherein the computing device stores code for recognizing the object from the digital image.

45. The pointing and identification system of claim 44, wherein the code comprises code for performing optical character recognition on text in the object.

46. The pointing and identification system of claim 45, wherein the code further comprises code for recognizing an Internet URL in the text.

47. The pointing and identification system of claim 44, wherein the code comprises code for performing image recognition on the object as represented in the digital image.

48. The pointing and identification system of claim 42, further comprising a plurality of markers for allowing the pointing and identification device to determine its location and orientation relative to the computing device.

49. The pointing and identification system of claim 48, wherein the plurality of markers are applied to a monitor of the computing device.

50. The pointing and identification system of claim 49, wherein the plurality of markers comprise markers for placement on corners of the monitor and a marker for placement on one side of the monitor to identify said one side.

51. The pointing and identification system of claim 50, wherein said one side is a top of the monitor.

52. The pointing and identification system of claim 42, wherein the computing device is in communication with a network for transmission of the digital image, or information extracted from the digital image, over the network.

53. The pointing and identification system of claim 52, wherein the network comprises the Internet.

54. The pointing and identification system of claim 28, wherein the aiming device comprises a laser.

55. The pointing and identification system of claim 54, wherein the laser is modulated to convey information.

56. The pointing and identification system of claim 55, wherein the information comprises an identity of the pointing and identification device.

57. The pointing and identification system of claim 54, wherein the laser is of variable intensity.

58. The pointing and identification system of claim 54, wherein the laser is one of an infrared laser and an ultraviolet laser.

59. The pointing and identification system of claim 54, wherein the laser is configured to display crosshairs on the object.

60. The pointing and identification system of claim 54, wherein the laser is configured to display an image on the object.

61. The pointing and identification system of claim 54, wherein the aiming device further comprises a reticle.

62. The pointing and identification system of claim 61, wherein the reticle is a fixed reticle.

63. The pointing and identification system of claim 61, wherein the reticle is a movable reticle.

64. The pointing and identification system of claim 28, wherein the aiming device comprises a reticle.

65. The pointing and identification system of claim 64, wherein the reticle is a fixed reticle.

66. The pointing and identification system of claim 64, wherein the reticle is a movable reticle.

67. The pointing and identification system of claim 28, wherein the communication device communicates with the different location wirelessly.

68. The pointing and identification system of claim 67, wherein the communication device communicates with the different location over a wireless networking protocol.

69. The pointing and identification system of claim 67, wherein the communication device communicates with the different location over a cellular telephone protocol.

70. The pointing and identification system of claim 28, further comprising a location/orientation device for determining at least one of a location and an orientation of the pointing and identification device, and wherein the communication device communicates said at least one of the location and orientation to the different location.

71. The pointing and identification system of claim 70, wherein the location/orientation device comprises a GPS receiver.

72. The pointing and identification system of claim 71, wherein the GPS receiver determines the locations of at least two points in the pointing and identification device to determine the orientation of the pointing and identification device.

73. The pointing and identification system of claim 70, wherein the location/orientation device determines a distance of the pointing and identification device from the object.

74. The pointing and identification system of claim 73, wherein the location/orientation device comprises a rangefinder.

75. The pointing and identification system of claim 74, wherein the rangefinder uses the laser.

76. The pointing and identification system of claim 74, wherein the rangefinder uses ultrasound.

77. The pointing and identification system of claim 28, wherein the pointing and identification device further comprises a gun-shaped housing.

78. The pointing and identification system of claim 77, wherein the at least one actuation means comprises a trigger.

79. The pointing and identification system of claim 28, wherein the at least one actuation means comprises:

a click-up button for enlarging an area of the image in which the object is identified; and

a click-down button for shrinking an area of the image in which the object is identified.

80. A method for automatically identifying an object, the method comprising:

(a) providing a pointing and identification device for pointing at the object, the pointing and identification device comprising;

at least one actuation means for actuation by the user when the user points the pointing and identification device at the object;

a digital camera for forming a digital image of the object or of a portion of the object when the user points the pointing and identification device at the object and actuates the at least one actuation means;

an aiming device for permitting the user to aim the pointing and identification device at the object; and

a communication device for communicating the digital image to a different location when the user actuates the at least one actuation means;

(b) communicating the digital image to the different location; and

(c) automatically identifying the object from the digital image at the different location;

wherein the object is at least one of a spot on a displayed image on a display, a subarea of a space on the displayed image on the display, one of a plurality of objects in the displayed image on the display, an object in space, a spot on or close to an object in space, a subarea of a surface in space, or one of a plurality of objects in space.

81. The method of claim 80, wherein step (c) comprises performing optical character recognition on text on the object.

82. The method of claim 80, wherein step (c) comprises reading a bar code on the object.

83. The method of claim 80, wherein the object is displayed on a screen as part of a movie or television program, and wherein step (c) comprises automatically identifying the television or movie program.

84. The method of claim 83, wherein step (c) comprises automatically identifying a frame in the television or movie program.

85. The method of claim 83, wherein step (c) comprises automatically identifying an advertisement in the television or movie program.

86. The method of claim 80, further comprising:

(d) automatically locating the object in a catalog of items for sale; and

(e) offering the user an opportunity to buy an item for sale corresponding to the object.

87. The method of claim 80, wherein step (c) comprises identifying the object by:

(i) receiving a designation of the object as designated by the user;

(ii) recording a frame image comprising the designated object;

(iii) determining a context type of the frame image from the frame image;

(iv) transferring data comprising the frame image and the context type to the different location; and

(v) identifying the object.

88. The method of claim 87, wherein step (c)(v) comprises:

(A) determining a context of the frame image from the context type and the frame image; and

(B) identifying the object from the context.

89. The method of claim 88, wherein step (c)(vi) further comprises:

(C) sending an identification of the object to the user;

(D) receiving from the user an indication of whether the identification of the object is correct;

(E) if the identification of the object is not correct, permitting the user to refine a search for the object; and

(F) performing steps (C)-(E) until the user indicates that the identification is correct.

90. A pointing and identification device for pointing at an object, the pointing and identification device comprising:

at least one actuation means for actuation by the user when the user points the pointing and identification device at the object;

a digital camera for forming a digital image of the object or of a portion of the object when the user points the pointing and identification device at the object and actuates the at least one actuation means; and

a processing device for reading indicia on the object from the digital image;

wherein the object is at least one of a spot on a displayed image on a display, a subarea of a space on the displayed image on the display, one of a plurality of objects in the displayed image on the display, an object in space, a spot on or close to an object in space, a subarea of a surface in space, or one of a plurality of objects in space.

91. The pointing and identification device of claim 90, wherein the indicial comprise text on the object.

92. The pointing and identification device of claim 90, wherein the indicia comprise a bar code on the object.

93. The pointing and identification device of claim 90, wherein the indicia comprise a tag affixed to the object for identifying at least one of a location and orientation of the object.

94. The pointing and identification device of claim 90, wherein the processing device provides the user with action options concerning the object.

95. The pointing and identification device of claim 94, wherein the action options comprise options for obtaining information on the object.

96. The pointing and identification device of claim 94, wherein the action options comprise options for purchasing the object.

97. The pointing and identification device of claim 94, wherein the action options comprise options for controlling the object.

98. The pointing and identification device of claim 94, wherein the action options comprise options for leading the user.

99. The pointing and identification device of claim 94, wherein the action options comprise options for putting the object on a list for later action.

100. A method for identifying an object, the method comprising:

(a) providing a pointing and identification device for pointing at the object, the pointing and identification device comprising;

at least one actuation means for actuation by the user when the user points the pointing and identification device at the object;

a digital camera for forming a digital image of the object or of a portion of the object when the user points the pointing and identification device at the object and actuates the at least one actuation means; and

a communication device for communicating the digital image to a different location when the user actuates the at least one actuation means;

(b) communicating the digital image to the different location;

(c) automatically identifying the object from the digital image at the different location to return a list of possible identifications of the object; and

(d) returning the list of possible identifications to the user to select one of the possible identifications as the object;

wherein the object is at least one of a spot on a displayed image on a display, a subarea of a space on the displayed image on the display, one of a plurality of objects in the displayed image on the display, an object in space, or near an object in space, a subarea of a surface in space, or one of a plurality of objects in space.

101. The method of claim 100, wherein step (c) comprises:

(i) receiving a designation of the object as designated by the user;

(ii) recording a frame image comprising the designated object;

(iii) determining a context type of the frame image from the frame image; and

(iv) identifying the object.

102. The method of claim 100, further comprising receiving a selection by the user of said one of the possible identifications as the object and an instruction from the user to obtain information on the object.

103. The method of claim 100, further comprising receiving a selection by the user of said one of the possible identifications as the object and an instruction from the user to purchase the object.