Method and apparatus for inputting information including coordinate data

• US 6,674,424 B1
• Filed: 10/30/2000
• Issued: 01/06/2004
• Est. Priority Date: 10/29/1999
• Status: Expired due to Term

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Ricoh Company Limited
• Inventors: Fujioka, Susumu
• Primary Examiner(s): Hjerpe, Richard
• Assistant Examiner(s): NGUYEN, FRANCIS N
• Application Number:
  US09/698,031
• Time in Patent Office: 1,163 Days
• Field of Search: 345/157, 345/175, 345/174-173, 178/18.01, 178/18.03, 178/18.07, 178/18.09, 178/19.01, 382/106, 250/559.29
• US Class Current: 345/157
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

A method, computer readable medium and apparatus for inputting information which includes coordinate data. The method includes extracting a predetermined object from an image which includes a predetermined object above a plane; detecting a motion of the predetermined object while the predetermined object is within a predetermined distance from the plane; and then determining whether to input predetermined information.

Claims

1. A method for inputting information including coordinate data comprising:

extracting a predetermined object from an image including the predetermined object above a plane;

recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member;

detecting a motion of the predetermined object while the predetermined object is within a predetermined distance from the plane; and

determining whether to input predetermined information.

2. A method for inputting information including coordinate data, comprising:

extracting an object from an image including the object above a plane;

recognizing a shape of the object and determining whether the object is a coordinate input member;

detecting a motion of the object that has been determined as the coordinate input member while the object is within a predetermined distance from the plane; and

determining whether to input predetermined information.

3. A method for inputting information including coordinate data, comprising:

extracting a predetermined object from an image including the predetermined object above a plane;

recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member;

inputting predetermined information while the predetermined object is within a first predetermined distance from the plane; and

displaying the predetermined information on the plane while the predetermined object is farther than the first predetermined distance from the plane and closer than a second predetermined distance from the plane.

4. A method for inputting information including coordinate data, comprising:

extracting a predetermined object from an image including the predetermined object above a plane;

recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member; and

inputting different predetermined categories of information according to a distance between the predetermined object and the plane while the predetermined object is within a predetermined distance from the plane.

5. The method according to claim 4, wherein the input information is a location of the predetermined object while the predetermined object is within the first predetermined distance from the plane.

6. The method according to claim 4, wherein the input information is determined based on a motion of the predetermined object while the predetermined object is farther than the first predetermined distance from the plane and closer than the second predetermined distance from the plane.

7. An apparatus for inputting information including coordinate data, comprising:

a plurality of one-dimensional image input devices each including one-dimensional imaging cells configured to input an image of a region on a plane configured to input coordinates;

an object extracting device configured to extract a predetermined object from an input image;

a ranging device configured to determine whether a distance between an extracted object and the plane is in a predetermined range;

a motion vector detecting device configured to detect motion vectors of the extracted object while the ranging device determines that the distance between the extracted object and the plane is in the predetermined range;

a motion recognizing device configured to recognize a coordinate inputting operation of the extracted object based on the motion vectors of the extracted object; and

a coordinate calculating device configured to calculate two-dimensional coordinates of the extracted object on the plane based on a formed image of the extracted object on the imaging cells of the image input device when the motion recognizing device recognizes the coordinate inputting operation.

8. The apparatus according to claim 7, further comprising:

an image data switching device configured to switch the plurality of one-dimensional image input devices to output large size image data when the ranging device determines that the distance between the extracted object and the plane is in the predetermined range, and to output small size image data when the ranging device determines that the distance is not in the predetermined range.

9. The apparatus according to claim 7, further comprising:

an imaging cell control device configured to output image data of a limited number of imaging cells corresponding to a predetermined region including the extracted object among the imaging cells of the plurality of one-dimensional image input devices when the ranging device determines that the distance between the extracted object and the plane is in the predetermined range.

10. The apparatus according to claim 7, wherein the motion vector detecting device detects the motion vectors of the extracted object for every predetermined quantity of image data being output from the imaging cells of the plurality of one-dimensional image input devices.

11. The apparatus according to claim 7, further comprising:

a memory device configured to store data,

wherein the motion recognizing device stores components of the motion vectors perpendicular to the plane into the memory device one after another, and then recognizes the coordinate inputting operation of the extracted object based on the data stored in the memory device.

12. The apparatus according to claim 7, further comprising:

a memory device configured to store data,

wherein the motion recognizing device stores components of the motion vectors perpendicular to the plane into the memory device one after another, and then recognizes the coordinate inputting operation of the extracted object when the motion recognizing device detects that a component of the motion vectors perpendicular to the plane has reversed from an advancing direction toward the plane into a leaving direction from the plane based on the data stored in the memory device.

13. An apparatus for inputting information including coordinate data, comprising:

an image input device including a plurality of imaging cells configured to input an image of a region on a plane configured to input coordinates;

an object extracting device configured to extract an object from an input image;

a shape recognition device configured to recognize a shape of an extracted object and to determine whether the extracted object is a coordinate input member;

a ranging device configured to determine whether a distance between the extracted object that has been determined as the coordinate input member and the plane is in a predetermined range;

a motion vector detecting device configured to detect motion vectors of the extracted object while the ranging device determines that the distance between the extracted object and the plane is in the predetermined range;

a motion recognizing device configured to recognize a coordinate inputting operation of the extracted object based on the motion vectors of the extracted object detected by the motion vector detecting device; and

a coordinate calculating device configured to calculate two-dimensional coordinates of the extracted object on the plane based on a formed image of the extracted object on the plurality of imaging cells of the image input device when the motion recognizing device recognizes the coordinate inputting operation.

14. The apparatus according to claim 13, further comprising:

an image data switching device configured to switch the image input device to output large size image data when the ranging device determines that the distance between the extracted object and the plane is in the predetermined range, and to output small size image data when the ranging device determines that the distance is not in the predetermined range.

15. The apparatus according to claim 13, further comprising:

an imaging cell control device configured to output image data of a limited number of imaging cells corresponding to a predetermined region including the extracted object among the plurality of imaging cells of the image input device when the ranging device determines that the distance between the extracted object and the plane is in the predetermined range.

16. The apparatus according to claim 13, wherein the motion vector detecting device detects motion vectors of the extracted object for every predetermined quantity of image data being output from the plurality of imaging cells of the image input device.

17. The apparatus according to claim 13, further comprising:

a memory device configured to store data,

wherein the motion recognizing device stores components of the motion vectors perpendicular to the plane into the memory device one after another, and then recognizes the coordinate inputting operation of the extracted object based on the data stored in the memory device.

18. The apparatus according to claim 13, further comprising:

a memory device configured to store data,

wherein the motion recognizing device stores components of the motion vectors perpendicular to the plane into the memory device one after another, and then recognizes the coordinate inputting operation of the extracted object when the motion recognizing device detects that a component of the motion vectors perpendicular to the plane has reversed from an advancing direction toward the plane into a leaving direction from the plane based on the data stored in the memory device.

19. An apparatus for inputting information including coordinate data, comprising:

an image input device including a plurality of imaging cells configured to input an image of a region on a plane configured to input coordinates;

an object extracting device configured to extract an object from an input image;

a shape recognition device configured to recognize a shape of an extracted object and determine whether the extracted object is a coordinate input member;

a ranging device configured to determine whether a distance between the extracted object that has been determined as the coordinate input member and the plane is in a predetermined range;

a motion vector detecting device configured to detect motion vectors of the extracted object while the ranging device determines that the distance between the extracted object and the plane is in the predetermined range;

a memory device configured to store data;

a motion recognizing device configured to store components of the motion vectors perpendicular to the plane into the memory device one after another, to bring the apparatus to a coordinate input state when a component of the motion vectors perpendicular to the plane has become zero, and to release the apparatus from the coordinate input state when the component of the motion vectors perpendicular to the plane has become a direction leaving from the plain; and

a coordinate calculating device configured to calculate two-dimensional coordinates of the extracted object on the plane based on a formed image of the extracted object on the plurality of imaging cells of the image input device while the apparatus is in the coordinate input state.

20. The apparatus according to claim 19, further comprising:

an image data switching device configured to switch the image input device to output large size image data when the ranging device determines that the distance between the extracted object and the plane is in the predetermined range, and to output small size image data when the ranging device determines that the distance is not in the predetermined range.

21. The apparatus according to claim 19, further comprising:

an imaging cell control device configured to output image data of a limited number of imaging cells corresponding to a predetermined region including the extracted object among the plurality of imaging cells when the ranging device determines that the distance between the extracted object and the plane is in the predetermined range.

22. The apparatus according to claim 19, wherein the motion vector detecting device detects the motion vectors of the extracted object for every predetermined quantity of image data being output from the plurality of imaging cells of the image input device.

23. An apparatus for inputting information including coordinate data, comprising:

a plurality of one-dimensional image input devices each including one-dimensional imaging cells configured to input a first image of a region on a plane configured to input coordinates;

at least a two-dimensional image input device including two-dimensional imaging cells configured to input a second image of the region on the plane configured to input the coordinates;

an object extracting device configured to extract a predetermined object from the second image input by the two-dimensional image input device;

a ranging device configured to determine whether a distance between an extracted object and the plane is in a predetermined range;

a motion vector detecting device configured to detect motion vectors of the extracted object while the ranging device determines that the distance between the extracted object and the plane is in the predetermined range;

a motion recognizing device configured to recognize a coordinate inputting operation of the extracted object based on the motion vectors of the extracted object detected by the motion vector detecting device; and

a coordinate calculating device configured to calculate two-dimensional coordinates of the extracted object on the plane based on a formed image of the extracted object on the one-dimensional imaging cells of the plurality of one-dimensional image input devices when the motion recognizing device recognizes the coordinate inputting operation.

24. The apparatus according to claim 23, further comprising:

an imaging cell control device configured to allow outputting of image data of the plurality of one-dimensional image input devices when the ranging device determines that the distance between the extracted object and the plane is in the predetermined range.

25. The apparatus according to claim 23, wherein the motion vector detecting device detects motion vectors of the extracted object for every predetermined quantity of image data being output from the imaging cells of the two-dimensional image input device.

26. The apparatus according to claim 23, further comprising:

a memory device configured to store data,

wherein the motion recognizing device stores components of the motion vectors perpendicular to the plane into the memory device one after another, and then recognizes the coordinate inputting operation of the extracted object based on the data stored in the memory device.

27. The apparatus according to claim 23, further comprising:

a memory device configured to store data,

wherein the motion recognizing device stores components of the motion vectors perpendicular to the plane into the memory device one after another, and then recognizes the coordinate inputting operation of the extracted object when the motion recognizing device detects that a component of the motion vectors perpendicular to the plane has reversed from an advancing direction toward the plane into a leaving direction from the plane based on the data stored in the memory device.

28. An apparatus for inputting information including coordinate data, comprising:

a plurality of one-dimensional image input devices each including one-dimensional imaging cells configured to input a first image of a region on a plane configured to input coordinates;

at least a two-dimensional image input device including two-dimensional imaging cells configured to input a second image of the region on the plane configured to input coordinates;

an object extracting device configured to extract a predetermined object from the second image input by the two-dimensional image input device;

a shape recognition device configured to recognize a shape of an extracted object and determine whether the extracted object is a coordinate input member;

a ranging device configured to determine a distance between the extracted object that has been determined as the coordinate input member and the plane is in a predetermined range;

a motion vector detecting device configured to detect motion vectors of the extracted object while the ranging device determines that the distance between the extracted object and the plane is in the predetermined range;

a motion recognizing device configured to recognize a coordinate inputting operation of the extracted object based on the motion vectors of the extracted object detected by the motion vector detecting device; and

a coordinate calculating device configured to calculate two-dimensional coordinates of the extracted object on the plane based on a formed image of the extracted object on the one-dimensional imaging cells of the plurality of one-dimensional image input devices when the motion recognizing device recognizes the coordinate inputting operation.

29. The apparatus according to claim 28, further comprising:

an imaging cell control device configured to allow outputting of image data of the plurality of one-dimensional image input devices when the ranging device determines that the distance between the extracted object and the plane is in the predetermined range.

30. The apparatus according to claim 28, wherein the motion vector detecting device detects motion vectors of the extracted object for every predetermined quantity of image data being output from the imaging cells of the two-dimensional image input device.

31. The apparatus according to claim 28, further comprising:

a memory device configured to store data,

wherein the motion recognizing device stores components of the motion vectors perpendicular to the plane into the memory device one after another, and then recognizes the coordinate inputting operation of the extracted object based on the data stored in the memory device.

32. The apparatus according to claim 28, further comprising:

a memory device configured to store data,

wherein the motion recognizing device stores components of the motion vectors perpendicular to the plane into the memory device one after another, and then recognizes the coordinate inputting operation of the extracted object when the motion recognizing device detects that a component of the motion vectors perpendicular to the plane has reversed from an advancing direction toward the plane into a leaving direction from the plane based on the data stored in the memory device.

33. An apparatus for inputting information including coordinate data, comprising:

an image input device including a plurality of imaging cells configured to input an image of a region on a plane configured to input coordinates;

an object extracting device configured to extract a predetermined object from an input image;

a first ranging device configured to determine whether a distance between an extracted object and the plane is in a first range;

a second ranging device configured to determine whether the distance between the extracted object and the plane is in a second range that is located farther than the first range from the plane;

a motion vector detecting device configured to detect motion vectors of the extracted object while the first ranging device determines that the distance between the extracted object and the plane is in the first range;

a motion recognizing device configured to recognize a coordinate inputting operation of the extracted object based on the motion vectors of the extracted object detected by the motion vector detecting device; and

a coordinate calculating device configured to calculate two-dimensional coordinates of the extracted object on the plane based on a formed image of the extracted object on the plurality of imaging cells of the image input device when the motion recognizing device recognizes the coordinate inputting operation.

34. The apparatus according to claim 33, wherein the motion vector detecting device detects motion vectors of the extracted object for every predetermined quantity of image data being output from the plurality of imaging cells of the image input device.

35. The apparatus according to claim 33, further comprising:

a memory device configured to store data,

wherein the motion recognizing device stores components of the motion vectors perpendicular to the plane into the memory device one after another, and then recognizes the coordinate inputting operation of the extracted object based on the data stored in the memory device.

36. The apparatus according to claim 33, further comprising:

a memory device configured to store data,

wherein the motion recognizing device stores components of the motion vectors perpendicular to the plane into the memory device one after another, and then recognizes the coordinate inputting operation of the extracted object when the motion recognizing device detects that a component of the motion vectors perpendicular to the plane has reversed from an advancing direction toward the plane into a leaving direction from the plane based on the data stored in the memory device.

37. An apparatus for inputting information including coordinate data, comprising:

means for extracting a predetermined object from an image including the predetermined object above a plane;

means for recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member;

means for detecting a motion of the predetermined object while the predetermined object is within a predetermined distance from the plane; and

means for determining whether to input predetermined information.

38. An apparatus for inputting information including coordinate data, comprising:

means for extracting an object from an image including the object above a plane;

means for recognizing a shape of the object and determining whether the object is a coordinate input member;

means for detecting a motion of the object that has been determined as the coordinate input member while the object is within a predetermined distance from the plane; and

means for determining whether to input predetermined information.

39. An apparatus for inputting information including coordinate data, comprising:

means for extracting a predetermined object from an image including the predetermined object above a plane;

means for recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member;

means for inputting predetermined information while the predetermined object is in a first predetermined distance from the plane; and

means for displaying the predetermined information on the plane while the predetermined object is farther than the first predetermined distance from the plane and closer than a second predetermined distance from the plane.

40. An apparatus for inputting information including coordinate data, comprising:

means for extracting a predetermined object from an image including the predetermined object above a plane;

means for recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member; and

means for inputting different predetermined categories of information according to a distance between the predetermined object and the plane while the predetermined object is within a predetermined distance from the plane.

41. A computer-readable medium carrying one or more sequences of one or more instructions for inputting information including coordinate data, the one or more sequences of one or more instructions including instructions which, when executed by one or more processors, cause the one or more processors to perform a process of:

extracting a predetermined object from an image including the predetermined object above a plane;

recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member;

detecting a motion of the predetermined object while the predetermined object is within a predetermined distance from the plane; and

determining whether to input predetermined information.

42. A computer-readable medium carrying one or more sequences of one or more instructions for inputting information including coordinate data, the one or more sequences of one or more instructions including instructions which, when executed by one or more processors, cause the one or more processors to perform a process of:

extracting an object from an image including the object above a plane;

recognizing a shape of the object and determining whether the object is a coordinate input member;

detecting a motion of the object that has been determined as the coordinate input member while the object is within a predetermined distance from the plane; and

determining whether to input predetermined information.

43. A computer-readable medium carrying one or more sequences of one or more instructions for inputting information including coordinate data, the one or more sequences of one or more instructions including instructions which, when executed by one or more processors, cause the one or more processors to perform a process of:

extracting a predetermined object from an image including the predetermined object above a plane;

recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member;

inputting predetermined information while the predetermined object is within a first predetermined distance from the plane; and

displaying the predetermined information on the plane while the predetermined object is farther than the first predetermined distance from the plane and closer than a second predetermined distance from the plane.

44. A computer-readable medium carrying one or more sequences of one or more instructions for inputting information including coordinate data, the one or more sequences of one or more instructions including instructions which, when executed by one or more processors, cause the one or more processors to perform a process of:

extracting a predetermined object from an image including the predetermined object above a plane;

recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member; and

inputting different predetermined categories of information according to a distance between the predetermined object and the plane while the predetermined object is within a predetermined distance from the plane.

45. A network system comprising:

a network configured to transmit data; and

a plurality of information inputting apparatuses, each of the information inputting apparatuses including;

an image display device configured to display images on a displaying surface thereof,

a plurality of image input devices, each configured to input images of a vicinity of the displaying surface of the image display device,

an object extracting device configured to extract coordinates and motions of a predetermined object located within a predetermined distance from the displaying surface of the image display device,

a shape recognition device configured to recognize a shape of the predetermined object and to determine whether the predetermined object is a coordinate input member,

a communication device configured to transmit information on the coordinates and motions of the predetermined object extracted by the object extracting device to other information inputting apparatuses via the network, and receive the information on coordinates and motions of the predetermined object from the other information inputting apparatuses via the network, and

a display control device configured to control images displayed on the displaying surface of the image display device according to the coordinates and motions of the predetermined object extracted by the object extracting device and according to information that is transmitted from the other information inputting apparatuses and received by the communication device via the network.

46. A network system comprising:

a network configured to transmit data;

a server configured to serve at least one of programs carrying one or more sequences of one or more instructions configured to extract coordinates and motions of an object, to transmit and receive information via the network, and to control images displayed on a display; and

a plurality of information inputting apparatuses, each of the information inputting apparatuses including;

an image display device configured to display images on a displaying surface thereof,

a plurality of image input devices, each configured to input images of a vicinity of the displaying surface of the image display device,

an object extracting device configured to extract coordinates and motions of a predetermined object located within a predetermined distance from the displaying surface of the image display device,

a shape recognition device configured to recognize a shape of the predetermined object and to determine whether the predetermined object is a coordinate input member,

a communication device configured to communicate information comprising information on the coordinates and motions of the predetermined object extracted by the object extracting device with the plurality of information inputting apparatuses via the network,

a display control device configured to control images displayed on the displaying surface of the image display device according to the coordinates and motions of the predetermined object extracted by the object extracting device and information that is transmitted from other information inputting apparatuses and received by the communication device via the network, and

a downloading device configured to download at least one of the programs served by the server into at least one of the object extracting device, the communication device, and the display control device via the network.

47. A network system comprising:

networking means for networking apparatuses and transmitting data among the apparatuses; and

a plurality of information inputting apparatuses, each of the information inputting apparatuses including;

image displaying means for displaying images on a displaying surface thereof,

means for inputting images of the vicinity of the displaying surface of the image displaying means,

object extracting means for extracting coordinates and motions of a predetermined object located within a predetermined distance from the displaying surface of the image displaying means,

means for recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member,

information transmitting and receiving means for transmitting information on the coordinates and motions of the predetermined object extracted by the object extracting means to other information inputting apparatuses via the networking means, and for receiving the information on the coordinates and motions of the predetermined object from the other information inputting apparatuses via the networking means, and

controlling means for controlling images displayed on the displaying surface of the image displaying means according to the coordinates and motions of the predetermined object extracted by the object extracting means and information received by the information transmitting and receiving means that is transmitted from the other information inputting apparatuses and received by the information transmitting and receiving means via the networking means.

48. A network system comprising:

networking means for networking apparatuses and transmitting data among the apparatuses;

program serving means for serving at least one of programs carrying one or more sequences of one or more instructions for extracting coordinates and motions of an object, for transmitting and receiving information via the networking means, and for controlling images displayed on an image displaying means; and

a plurality of information inputting apparatuses, each of the information inputting apparatuses including;

image displaying means for displaying images on a displaying surface thereof,

means for inputting images of the vicinity of the displaying surface of the image displaying means,

object extracting means for extracting coordinates and motions of a predetermined object located within a predetermined distance from the displaying surface of the image displaying means,

means for recognizing a shape of the predetermined object and determining whether the predetermined object is a coordinate input member,

information transmitting and receiving means for transmitting information on the coordinates and motions of the predetermined object extracted by the object extracting means to other information inputting apparatuses via the networking means, and for receiving the information on the coordinates and motions of the predetermined object from the other information inputting apparatuses via the networking means,

display control means for controlling images displayed on the displaying surface of the image displaying means according to the coordinates and motions of the predetermined object extracted by the object extracting means and information received by the information transmitting and receiving means that is transmitted from the other information inputting apparatuses and received by the information transmitting and receiving means via the networking means, and

downloading means for downloading at least one of the programs served by the program serving means into at least one of the object extracting means, the information transmitting and receiving means, and the display control means via the networking means.