Using clear-coded, see-through objects to manipulate virtual objects
First Claim
1. A system that includes objects that are generally optically transparent to visible light through which portions of an image are transmitted using visible light, so that as the objects are moved about, the portions of the image move with the objects, comprising:
- (a) a source of non-visible light for illuminating the objects;
(b) an image source that produces images using visible light;
(c) a sensor for producing a signal in response to non-visible light that is received from the objects;
(d) a memory in which machine instructions are stored;
(e) a processor coupled to the image source, the sensor, and the memory, said processor executing the machine instructions to carry out a plurality of functions, including;
(i) responding with the sensor to a distinctive marking applied to each of the objects in the signal produced by the sensor, the marking comprising a material that substantially transmits visible light, but which affects light in a non-visible waveband from the non-visible light source, by one of;
(A) reflecting the light in the non-visible waveband; and
(B) absorbing the light in the non-visible waveband;
(ii) identifying and detecting a location and an orientation of each object, in response to the signal produced by the sensor that receives light in the non-visible waveband from the objects; and
(iii) causing the image source to transmit the portions of the image through the objects as visible light, so that each portion of the image is associated with the object through which the portion of the image is visible, so that when the objects are assembled in a correct layout, the image is clearly apparent by collectively viewing the portions of the image visible through the objects that are thus assembled, said objects representing the image in a manner similar to pieces of a jigsaw puzzle that are correctly assembled to display a picture.
3 Assignments
0 Petitions
Accused Products
Abstract
An object placed on an interactive display surface is detected and its position and orientation are determined in response to IR light that is reflected from an encoded marking on the object. Upon detecting the object on an interactive display surface, a software program produces a virtual entity or image visible through the object to perform a predefined function. For example, the object may appear to magnify text visible through the object, or to translate a word or phrase from one language to another, so that the translated word or phrase is visible through the object. When the object is moved, the virtual entity or image that is visible through the object may move with it, or can control the function being performed. A plurality of such objects can each display a portion of an image, and when correctly positioned, together will display the entire image, like a jigsaw puzzle.
-
Citations
58 Claims
-
1. A system that includes objects that are generally optically transparent to visible light through which portions of an image are transmitted using visible light, so that as the objects are moved about, the portions of the image move with the objects, comprising:
-
(a) a source of non-visible light for illuminating the objects; (b) an image source that produces images using visible light; (c) a sensor for producing a signal in response to non-visible light that is received from the objects; (d) a memory in which machine instructions are stored; (e) a processor coupled to the image source, the sensor, and the memory, said processor executing the machine instructions to carry out a plurality of functions, including; (i) responding with the sensor to a distinctive marking applied to each of the objects in the signal produced by the sensor, the marking comprising a material that substantially transmits visible light, but which affects light in a non-visible waveband from the non-visible light source, by one of; (A) reflecting the light in the non-visible waveband; and (B) absorbing the light in the non-visible waveband; (ii) identifying and detecting a location and an orientation of each object, in response to the signal produced by the sensor that receives light in the non-visible waveband from the objects; and (iii) causing the image source to transmit the portions of the image through the objects as visible light, so that each portion of the image is associated with the object through which the portion of the image is visible, so that when the objects are assembled in a correct layout, the image is clearly apparent by collectively viewing the portions of the image visible through the objects that are thus assembled, said objects representing the image in a manner similar to pieces of a jigsaw puzzle that are correctly assembled to display a picture. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
- 8. An object for providing input to carry out a predefined function, comprising an encoded marking applied to at least one surface of a material that is optically transparent to visible light comprising the object, the encoded marking serving to identify the object, its position on a display surface that is coupled to a computing system, and an orientation of the object on the display surface, the encoded marking comprising a material that substantially transmits visible light without affecting the visible light, but which modifies a non-visible light so that the object is readily identified in response to the modification of the non-visible light, identification of the object providing an input to a computing system that causes a function associated with the object to be implemented by the computing system that affects a virtual entity or image formed with visible light that passes through the object.
-
11. A method for enabling an object having at least a substantial central part that is generally optically transparent to visible light, to be optically recognized in response to non-visible light received from the object without substantially affecting visible light transmission through the object, comprising the steps of:
-
(a) applying a first marking on a first surface of the object, said first marking comprising a material that substantially transmits visible light, but which affects light in a non-visible waveband by one of; (i) reflecting the light in the non-visible waveband; and (ii) absorbing the light in the non-visible waveband; (b) directing light in the non-visible waveband onto the first surface of the object where the first marking is applied; and (c) detecting an image of at least a portion of the object, in response to light in the non-visible waveband that is received from the object, the image enabling the object to be recognized. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31)
-
-
32. A method for employing objects that are generally optically transparent to visible light and through which portions of an image are transmitted using visible light, so that as the objects are moved about, the portions of the image move with the objects, comprising the steps of:
-
(a) applying a distinctive marking to each of the objects, the marking comprising a material that substantially transmits visible light, but which affects light in a non-visible waveband by one of; (i) reflecting the light in the non-visible waveband; and (ii) absorbing the light in the non-visible waveband; (b) directing light in the non-visible waveband onto the objects where the marking is applied; (c) identifying and detecting a location and an orientation of each object, in response to light in the non-visible waveband that is received from the objects; (d) transmitting the portions of the image through the objects as visible light, so that each portion of the image is associated with the object through which the portion of the image is visible; and (e) enabling the objects to be assembled in a correct layout, so that the image is clearly apparent by collectively viewing the portions of the image visible through the objects that are thus assembled, said objects representing the image in a manner similar to pieces of a jigsaw puzzle that are correctly assembled to display a picture. - View Dependent Claims (33, 34, 35, 36, 37, 38, 39)
-
-
40. A system on which an object, which is generally optically transparent to visible light, is optically recognized in response to non-visible light received from the object, without substantially effecting visible light transmission through the object, comprising:
-
(a) a source of non-visible light for illuminating an object; (b) an image source that produces an image using visible light; (c) a sensor for producing a signal in response to non-visible light that is received from the object; (d) a memory in which machine instructions are stored; (e) a processor coupled to the image source, the sensor, and the memory, said processor executing the machine instructions to carry out a plurality of functions, including; (i) detecting light received from the object with the sensor, producing the signal, wherein the object has a first marking applied to a first surface of the object, said first marking comprising a material that substantially transmits visible light, but which affects non-visible light from the source of non-visible light, by one of; (A) reflecting the light in the non-visible waveband; and (B) absorbing the light in the non-visible waveband; and (ii) in response to the signal produced by the sensor, identifying the object. - View Dependent Claims (41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58)
-
Specification