Method and apparatus for controlling computer without touching input device

• US 5,900,863 A
• Filed: 03/13/1996
• Issued: 05/04/1999
• Est. Priority Date: 03/16/1995
• Status: Expired due to Fees

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Numazaki, Shunichi
• Primary Examiner(s): Hofsass, Jeffery A.
• Assistant Examiner(s): TWEEL JR, JOHN ALEXANDER
• Application Number:
  US08/614,502
• Time in Patent Office: 1,147 Days
• Field of Search: 345/158, 345/157, 345/156, 345/159, 345/160, 345/12, 345/7, 345/175, 348/140, 348/141
• US Class Current: 345/158
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image

Abstract

A distance image representing a distribution of distances, each measured between the apparatus and each conceivable point existing on an object is input. The minimum points in the distance image are detected. The minimum points are some of the conceivable points on the object which have smaller distance values than the other conceivable points. The time differences, each representing a change which each point in the distance image assumes as time passes, are detected. A designating point for designating a command to the system is determined. The designating point is one of the minimum points which has changed in the time difference detected. A system is controlled in accordance with motion of the designating point determined.

Claims

1. A data input apparatus comprising:

distance image input means for inputting a distance image representing a distribution of distances measured between the apparatus and a plurality of conceivable points existing on an object;

point determining means for determining a designating point in the distance image input by said distance image input means, wherein said designating point is one of the plurality of conceivable points on the object which has least distance value; and

system control means for controlling a system in accordance with motion of the designating point determined by said point determining means.

2. A data input apparatus according to claim 1, wherein said distance image input means comprises:

light-emitting means comprising an array of light-emitting elements;

light emission control means for controlling said array of light-emitting elements such that light beams are emitted, one after another, from the light-emitting elements to an object;

light-detecting means for detecting a position which each light beam reflected from the object assumes;

distance calculating means for calculating a distance between the apparatus and the object from the position of the light beam detected by said light-detecting means and a position of the light-emitting element which has emitted the light beam; and

minimum point detecting means for detecting a plurality of minimum points in the distance image input by said distance image input means, wherein said plurality minimum points is a group of the plurality of conceivable points on the object which has smaller distance values than other ones of the plurality of conceivable points.

3. A data input apparatus according to claim 2, wherein said distance calculating means includes means for preventing the outputs of said light detecting means from being used, when a difference between the outputs of said light detecting means falls outside a predetermined range.

4. A data input apparatus according to claim 1, wherein said system control means comprises:

cursor controlling means for displaying and controlling a cursor at a position on a display screen, which corresponds to the designating point determined by said point determining means;

conversion means for converting a locus of the cursor moving on the display screen into a command for controlling the system; and

command executing means for executing the command generated by said conversion means.

5. A data input apparatus according to claim 1, further comprising filter means for filtering coordinate values or distance value, or both, of the designating point determined by said point determining means.

6. A data input apparatus according to claim 1, further comprising:

point-halting time detecting means for detecting a time for which the designating point determined by said point determining means remains within a predetermined region;

point-menu correspondence detecting means for associating a position of the designating point with any one of menu items displayed on a display screen; and

command executing means for executing the menu item detected by said point-menu correspondence detecting means, when an output of said point-halting time detecting means satisfies specific conditions.

7. A data input apparatus comprising:

distance image generating means for generating a distance image, representing a distribution of distances measured between the apparatus and a plurality of conceivable points existing on an object, from an output which a light-receiving means generates while a light-emitting means is emitting a light beam and from an output which said light-receiving means generates while said light-emitting means is emitting no light beam;

minimum point detecting means for detecting a plurality of minimum points in the distance image generated by said distance image generating means, wherein said plurality of minimum points is a group of the plurality of conceivable points on the object which has smaller distance values than other ones of the plurality of conceivable points;

point determining means for determining at least one designating point for designating a command to a system in accordance with a specific rule, wherein said at least one designating point is at least one of the plurality of minimum points detected by said minimum point detecting means; and

system control means for controlling the system in accordance with motion of said at least one designating point determined by said point determining means.

8. The data input apparatus according to claim 7, further comprising:

time difference detecting means for detecting time differences, each representing a change which each point in the distance image assumes as time passes,

wherein said point determining means includes means for determining a designating point for designating a command to the system, said designating point being one of the plurality of minimum points which has changed in the time differences detected by said time difference detecting means.

9. The data input apparatus according to claim 8, wherein said system control means comprises:

cursor controlling means for displaying and controlling a cursor at a position on a display screen, which corresponds to the designating point determined by said point determining means;

conversion means for converting a locus of the cursor moving on the display screen into a command for controlling the systems; and

command executing means for executing the command generated by said conversion means.

10. The data input apparatus according to claim 7, further comprising:

time difference detecting means for detecting time differences, each representing a change which each point in the distance image assumes as time passes,

wherein said point determining means includes means for determining a designating point for designating a command to the system, said designating point being one of the plurality of minimum points which has least time difference falling within a predetermined range.

11. A data input apparatus according to claim 10, wherein said system control means comprises:

cursor controlling means for displaying and controlling a cursor at a position on a display screen, which corresponds to the designating point determined by said point determining means;

conversion means for converting a locus of the cursor moving on the display screen into a command for controlling the system; and

command executing means for executing the command generated by said conversion means.

12. A data input apparatus according to claim 7, wherein said distance image generating means comprises:

light-emitting means comprising an array of light-emitting elements;

light emission control means for controlling said light-emitting elements such that light beams are emitted, one after another, from the light-emitting elements to the object;

light-detecting means for detecting a position which each light beam reflected from the object assumes; and

distance calculating means for calculating a distance between the apparatus and the object from the position of the light beam detected by said light-detecting means and a position of the light-emitting element which has emitted the light beam.

13. The data input apparatus according to claim 7, wherein said minimum point detecting means comprises:

means for detecting motion of each one of said plurality of minimum points; and

means for selecting at least one of the minimum points in accordance with an output of said means for detectings aid motion of said each one of said plurality of minimum points.

14. The data input apparatus according to claim 7, wherein said minimum point detecting means comprises:

means for analyzing entities existing near each one of said plurality of minimum points; and

means for selecting at least one of the plurality of minimum points in accordance with an output of said means for analyzing entities existing near each one of said plurality of minimum points.

15. A data input apparatus according to claim 7, further comprising filter means for filtering at least one of coordinate values and a distance value of the designating point designated by said point designating means.

16. A data input apparatus according to claim 7, further comprising:

point-halting time detecting means for detecting a time for which the designating point determined by said point determining means remains within a predetermined region;

point-menu correspondence detecting means for associating a position of the designating point with any one of menu items displayed on a display screen; and

command executing means for executing the menu item detected by said point-menu correspondence detecting means, when an output of said point-halting time detecting means satisfies specific conditions.

17. A data input apparatus according to claim 7, further comprising:

first point-motion detecting means for detecting one of the plurality of minimum points which corresponds to a finger tip; and

second point-motion detecting means for detecting movement of the finger tip to select a menu item.

18. A data input apparatus, comprising:

light emitting means for emitting a light;

means for obtaining as an image a magnitude of a reflected light obtained by the light emitted by the light emitting means being reflected by an object;

extraction means for extracting geometrical data of the object by processing the obtained image; and

system control means for controlling an operation of a system to be operated by using the geometrical data.

19. The data input apparatus according to claim 18, wherein said means for obtaining comprises a photodetector array.

20. The data input apparatus according to claim 18, further comprising:

light-receiving means for receiving a modulated light beam reflected by an object;

extracting means for extracting a modulated component of the light beam received by said light-receiving means; and

measuring means for measuring a magnitude of the modulated component extracted by said extracting means.

21. The data input apparatus according to claim 18, further comprising:

light-receiving means for receiving a light beam reflected by an object;

extracting means for extracting a component of the light beam received by said light-receiving means;

measuring means for measuring a magnitude of the component, which has been extracted by said extracting means;

image generating means for generating an image of the object from the magnitude of the component, which has been measured by said measuring means;

correcting means for correcting a plurality of values of a plurality of pixels to cause a sum of the plurality of values to meet a predetermined condition, wherein said plurality of pixels defines a part of the image generated by said image generating means, which is a tip of a rod-shaped object; and

gravity center detecting means for detecting a center of gravity of the tip of the rod-shaped object, from the values of the plurality of pixels, which have been corrected by said correcting means.

22. An image processing method comprising the steps of:

correcting a plurality of values of a plurality of pixels to cause a sum of the plurality of values to meet a predetermined condition, wherein said plurality of pixels defines a part of an image of a rod-shaped object;

detecting a center of gravity of a tip of the rod-shaped object, from the corrected values of the plurality pixels; and

calculating a position of the tip of the rod-shaped object, from the center of gravity detected.

23. An article of manufacture comprising a computer usable medium having computer readable program code means embodied therein for causing information to be input, the computer readable program code means in said article of manufacture comprising:

computer readable program code means for correcting a plurality of values of a plurality of pixels to cause a sum of the plurality of values to meet a predetermined condition, wherein said plurality of pixels defines a part of an image of a rod-shaped object;

computer readable program code means for detecting a center of gravity of the tip of the rod-shaped object, from the corrected plurality values of the pixels; and

computer readable program code means for calculating a position of the tip of the rod-shaped object, from the center of gravity detected.

24. A data input method, comprising the computer steps of:

a) inputting a distance image;

b) obtaining a minimum point having a shortest distance value among the input distance images;

c) controlling a system to be operated by using the obtained minimum point.

25. A data input method, comprising the computer steps of:

a) inputting a distance image representing a distribution of distances measured between an apparatus and a plurality of conceivable points existing on an object;

b) determining a designating point in the input distance image, wherein said designating point is one of the plurality of conceivable points on the object which has least distance value; and

c) controlling a system in accordance with motion of the determined designating point.

26. A data input method, comprising the computer steps of:

a) inputting a distance image representing a distribution of distances measured between an apparatus and a plurality of conceivable point existing on an object;

b) detecting a plurality of minimum points in the input distance image, wherein said plurality of minimum points is a group of the plurality of conceivable points on the object which has smaller distance values than the other ones of the plurality of conceivable points;

c) detecting time differences, each one of the time differences representing a change which each point in the distance image assumes as time passes;

d) determining a designating point for designating a command to a system, wherein said designating point is one of the plurality minimum points which has changed in the detected time differences; and

e) controlling the system in accordance with motion of the determined designating point.

27. A data input method, comprising the computer steps of:

a) inputting a distance image representing a distribution of distances measured between an apparatus and a plurality of conceivable points existing on an object;

b) detecting a plurality of minimum points in the input distance image, wherein said plurality of minimum points is a group of the plurality conceivable points on the object which has smaller distance values than other ones of the plurality of conceivable points;

c) detecting time differences, each one of the time differences representing a change which each point in the distance image assumes as time passes;

d) determining a designating point for designating a command to a system, wherein said designating point is one of the plurality of minimum points which has least time difference falling within a predetermined range; and

e) controlling the system in accordance with motion of the determined designating point.

28. A data input method, comprising the computer steps of:

a) generating a distance image, representing a distribution of distances measured between the apparatus and a plurality of conceivable points existing on an object, from an output which a light-receiving means generates while a light-emitting means is emitting a light beam and from an output which said light-receiving means generates while said light-emitting means is emitting no light beam;

b) detecting a plurality of minimum points in the generated distance image, wherein said plurality of minimum points is a group of a plurality of conceivable points on an object which has smaller distance values than other ones of the plurality of conceivable points;

c) determining at least one designating point for designating a command to a system in accordance with a specific rule, wherein said at least one designating point is at least one of the detected plurality of minimum points; and

d) controlling the system in accordance with motion of said at least one designating point determined.

29. A computer data input method, comprising the steps of:

a) emitting a light;

b) obtaining as an image a magnitude of a reflected light obtained by the light emitted by a light emitting means being reflected by an object;

c) extracting geometrical data of the object by processing the obtained image; and

d) controlling an operation of a system to be operated by using the geometrical data.

30. An article of manufacture comprising a computer usable medium having computer readable program code means embodied therein for causing information to be input, the computer readable program code means in said article of manufacture, comprising:

computer readable program code means for inputting a distance image which is a distribution between an object and a distance;

computer readable program code means for obtaining a minimum point whose distance is minimum among input distance images; and

computer readable program code means for controlling a system by using the obtained minimum point.

31. An article of manufacture comprising a computer usable medium having computer readable program code means embodied therein for causing information to be input, the computer readable program code means in said article of manufacture comprising:

computer readable program code means for inputting a distance image which is a distribution between an object and a distance;

computer readable program code means for determining, among input distance images, a point having minimum distance value as an instructing point for instructing a system to be operated; and

computer readable program code means for controlling an operation of the system to be operated based on movement of the determined instructing point.

32. An article of manufacture comprising a computer usable medium having computer readable program code means embodied therein for causing information to be input, the computer readable program code means in said article of manufacture, comprising:

computer readable program code means for inputting a distance image which is a distribution between an object and a distance;

computer readable program code means for obtaining a minimum point whose distance value is locally minimum among input distance images;

computer readable program code means for detecting time difference which is a variable amount of the distance value corresponding to a time of the input distance image;

computer readable program code means for determining among a plurality of detected minimum points, one minimum point in which the detected time difference is varied as an instructing point for instructing a system to be operated; and

computer readable program code means for controlling an operation of the system to be operated based on the operation of the determined instructing point.

33. An article of manufacture comprising a computer usable medium having computer readable program code means embodied therein for causing information to be input, the computer readable program code means in said article of manufacture comprising:

computer readable program code means for inputting a distance image which is a distribution between an object and a distance;

computer readable program code means for obtaining a minimum point whose distance value is locally minimum among input distance images;

computer readable program code means for detecting time difference which is a variable amount of the distance value corresponding to a time of the input distance image;

computer readable program code means for determining, among plurality of detected minimum points, one minimum point in which the time difference of the distance has a certain range of values and which has a minimum value, as an instructing point for instructing a system to be operated; and

computer readable program code means for controlling an operation of the system to be operated based on the operation of the determined instructing point.