Information input/output system and information input/output method
First Claim
1. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system comprising:
- one or more than one operation surfaces arranged in said information space;
a display means for displaying an image on said operation surfaces;
an imaging means for picking up an image of said operation surfaces;
an environment type computer stationarily arranged in said information space; and
one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof;
said environmental type computer being adapted to execute;
a processing operation of recognizing the identification information and the position information of each of said physical objects in said visual marker;
a processing operation of recognizing the digital object dropped to a site on the surface of each of said physical objects; and
a processing operation of forming link information for linking the digital object to the dropped site on the surface for each of said physical objects.
1 Assignment
0 Petitions
Accused Products
Abstract
A digital object is manipulated by way of a physical object. As a digital space on a computer is deeply fused with a physical real space, it becomes possible to input user commands not only by way of native user input devices such as a mouse and a keyboard but also various physical objects that are scattered in the real world and draw out a digital object by way of a physical object. As a result, computers can be operated in a more intuitive and easy way and become attractive to the users.
245 Citations
35 Claims
-
1. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system comprising:
-
one or more than one operation surfaces arranged in said information space;
a display means for displaying an image on said operation surfaces;
an imaging means for picking up an image of said operation surfaces;
an environment type computer stationarily arranged in said information space; and
one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof;
said environmental type computer being adapted to execute;
a processing operation of recognizing the identification information and the position information of each of said physical objects in said visual marker;
a processing operation of recognizing the digital object dropped to a site on the surface of each of said physical objects; and
a processing operation of forming link information for linking the digital object to the dropped site on the surface for each of said physical objects. - View Dependent Claims (2, 3, 4, 5)
-
-
6. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system comprising:
-
one or more than one operation surfaces arranged in said information space;
a display means for displaying an image on said operation surfaces;
an imaging means for picking up an image of said operation surfaces;
an environment type computer stationarily arranged in said information space;
one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof; and
a portable ID recognition device adapted to recognize/identify the visual marker on the surface of each of said physical objects. - View Dependent Claims (7, 8)
-
-
9. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system comprising:
-
one or more than one operation surfaces arranged in said information space;
a display means for displaying an image on said operation surfaces;
an imaging means for picking up an image of said operation surfaces;
an environment type computer stationarily arranged in said information space; and
one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof;
at least one of said physical objects being a virtual camera having a virtual imaging direction as specified by the position information contained in the visual marker. - View Dependent Claims (10, 11)
-
-
12. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system comprising:
-
one or more than one operation surfaces arranged in said information space;
a display means for displaying an image on said operation surfaces;
an imaging means for picking up an image of said operation surfaces;
an environment type computer stationarily arranged in said information space;
one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof; and
an optical pointer adapted to point a specific position by irradiating a beam of light with a predetermined wavelength;
said imaging means being capable of identifying the position pointed by said optical pointer. - View Dependent Claims (13)
-
-
14. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system comprising:
-
one or more than one operation surfaces arranged in said information space;
a display means for displaying an image on said operation surfaces;
an imaging means for picking up an image of said operation surfaces;
an environment type computer stationarily arranged in said information space; and
one or more than one portable computers capable of exchanging digital objects with other computers;
said portable computers being capable of retrieving a three-dimensional model and/or generating a three-dimensional model thereon;
said environment type computer being adapted to execute;
a processing operation of generating an image to be projected on said operation surfaces on the basis of the information for drawing a three-dimensional model in response to the application of the user operation of taking out the three-dimensional model from one of said portable computers to said operation surfaces, and a processing operation of controlling a display of the projected image generated by said display means.
-
-
15. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system comprising:
-
one or more than one operation surfaces arranged in said information space;
a display means for displaying an image on said operation surfaces;
an imaging means for picking up an image of said operation surfaces;
an environment type computer stationarily arranged in said information space;
one or more than one portable computers capable of exchanging digital objects with other computers;
one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof; and
a portable ID recognition device adapted to recognize the visual marker on the surface of each of said physical objects and being capable of holding or releasing the recognized identification information. - View Dependent Claims (16)
-
-
17. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system comprising:
-
one or more than one operation surfaces arranged in said information space;
a display means for displaying an image on said operation surfaces;
an imaging means for picking up an image of said operation surfaces;
an environment type computer stationarily arranged in said information space;
one or more than one portable computers capable of exchanging digital objects with other computers; and
one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof;
said environment type computer being adapted to allow mouse/cursor operations on said portable computers to extend to said operation surfaces and display a rubber band as visual feedback according to the area on said operation surfaces as defined by means of said mouse/cursor. - View Dependent Claims (18, 19, 20, 21)
-
-
22. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said information space having one or more than one operation surfaces arranged in said information space, a display means for displaying an image on said operation surfaces, an imaging means for picking up an image of said operation surfaces, an environment type computer stationarily arranged in said information space and one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof, said system comprising:
-
a step of firstly recognizing the identification information and the position information of each of said physical objects from the visual marker;
a step of secondly recognizing the digital object dropped to a site on the surface of each of said physical objects; and
a step of forming link information for linking the digital object to the dropped site on the surface for each of said physical objects. - View Dependent Claims (23, 24, 25)
-
-
26. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system having one or more than one operation surfaces arranged in said information space, a display means for displaying an image on said operation surfaces, an imaging means for picking up an image of said operation surfaces, an environment type computer stationarily arranged in said information space, one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof and a portable ID recognition device adapted to recognize/identify the visual marker on the surface of each of said physical objects, said system comprising:
-
a step of receiving the identification information of the source object and that of the destination object from said ID recognition device; and
a step of applying an action specified on the basis of the combination of the type of the source object and that of the destination object.
-
-
27. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system having one or more than one operation surfaces arranged in said information space, a display means for displaying an image on said operation surfaces, an imaging means for picking up an image of said operation surfaces, an environment type computer stationarily arranged in said information space and one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof, at least one of said physical objects being a virtual camera having a virtual imaging direction as specified by the position information contained in the visual marker, said system comprising:
-
a step of recognizing/identifying said virtual camera and identifying the position information and the virtual imaging direction;
a step of generating a virtual picked up image according to the position information and the virtual imaging direction; and
a step of displaying the virtual picked up image to the user.
-
-
28. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system having one or more than one operation surfaces arranged in said information space, a display means for displaying an image on said operation surfaces, an imaging means for picking up an image of said operation surfaces, an environment type computer stationarily arranged in said information space, one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof and an optical pointer adapted to point a specific position by irradiating a beam of light with a predetermined wavelength, said imaging means being capable of identifying the position pointed by said optical pointer, said system comprising:
-
a step of recognizing the user operation on said operation surfaces, using said optical pointer; and
a step of controlling the display of the digital object by said display means according to the result of the recognition.
-
-
29. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system having one or more than one operation surfaces arranged in said information space, a display means for displaying an image on said operation surfaces, an imaging means for picking up an image of said operation surfaces, an environment type computer stationarily arranged in said information space and one or more than one portable computers capable of exchanging digital objects with other computers, said portable computers being capable of retrieving a three-dimensional model and/or generating a three-dimensional model thereon, said system comprising:
-
a step of generating an image to be projected on said operation surfaces on the basis of the information for drawing a three-dimensional model in response to the application of the user operation of taking out the three-dimensional model from one of said portable computers to said operation surfaces; and
a step of controlling the display of said generated and projected image of said display means.
-
-
30. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system having one or more than one operation surfaces arranged in said information space, a display means for displaying an image on said operation surfaces, an imaging means for picking up an image of said operation surfaces, an environment type computer stationarily arranged in said information space and one or more than one portable computers capable of exchanging digital objects with other computers, one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof and a portable ID recognition device adapted to recognize the visual marker on the surface of each of said physical objects and being capable of holding or releasing the recognized identification information, said system comprising:
-
a step of obtaining a digital object corresponding to the held identification information in response to the holding operation of said ID recognition device; and
a step of transferring a digital object corresponding to the held identification information to a nearby physical object in response to the releasing operation of said ID recognition device.
-
-
31. An information input/output system to be used for user operations relating to an object in an information space realized by expanding a digital space of a computer into the real world, said system having one or more than one operation surfaces arranged in said information space, a display means for displaying an image on said operation surfaces, an imaging means for picking up an image of said operation surfaces, an environment type computer stationarily arranged in said information space, one or more than one portable computers capable of exchanging digital objects with other computers and one or more than one physical objects mounted on said operation surfaces and containing a visually identifiable visual marker on the surface thereof, said system comprising:
-
a step of allowing mouse/cursor operations on said portable computers to extend to said operation surfaces; and
a step of displaying a rubber band as visual feedback according to the scope on said operation surfaces as defined by means of said mouse/cursor. - View Dependent Claims (32, 33, 34, 35)
-
Specification