System and method for determining an input selected by a user through a virtual interface

• US 7,151,530 B2
• Filed: 08/20/2003
• Issued: 12/19/2006
• Est. Priority Date: 08/20/2002
• Status: Expired due to Fees

• Current Assignee: Heilongjiang Golden Jumping Group Co., Ltd.
• Original Assignee: Canesta Incorporated (Microsoft Corporation)
• Inventors: Rafii, Abbas, Torunoglu, Ilhami, Roeber, Helena
• Primary Examiner(s): Hjerpe, Richard
• Assistant Examiner(s): NGUYEN, KIMNHUNG T
• Application Number:
  US10/645,765
• Publication Number:
  US 20040136564A1
• Time in Patent Office: 1,217 Days
• Field of Search: 345156-158, 345168-170, 341 21- 23, 382/100, 382/106
• US Class Current: 345/168
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32

Abstract

A system and method for determining which key value in a set of key values is to be assigned as a current key value as a result an object intersecting a region where a virtual interface is provided. The virtual interface may enable selection of individual key values in the set. The position is determined using a depth sensor that determines a depth of the position in relation to the location of the depth sensor. A set of previous key values that are pertinent to the current key value may also be identified. In addition, at least one of either a displacement characteristic of the object, or a shape characteristic of the object is determined. A probability is determined that indicates the current key value is a particular one or more of the key values in the set.

Claims

1. A method for determining which key value in a set of key values is to be assigned as a current key value as a result an object intersecting a region where a virtual interface for enabling selection of individual key values in the set of key values is provided, the method comprising:

determining a position of where the object intersects the region using, at least in part, a depth sensor that determines a depth of the position in relation to a position of the depth sensor;

identifying a set of one or more historical key values that are pertinent to the current key value;

determining at least one of (i) a displacement characteristic of the object or (ii) a shape characteristic of object; and

indicating a probability that the current key value is a particular one or more of the key values in the set of key values based on the position, the set of one or more historical key values, and the at least one of the displacement characteristic or the shape characteristic.

2. The method of claim 1, wherein the step of indicating a probability that the current key value is a particular one or more of the key values in the set of key values includes indicating, for each particular key value in the set of key values, that the particular key value is the current key value.

3. The method of claim 2, wherein the step of indicating a probability that the current key value is a particular one or more of the key values in the set of key values includes providing an external electronic device with data corresponding to the likelihood that each key value in the set of key values is the current key value.

4. The method of claim 1, further comprising the step of providing the virtual interface by providing a light-generated keyboard over a surface, and monitoring a portion of the surface where the light-generated keyboard is provided in order to detect contact between any object and the surface.

5. The method of claim 4, wherein the step of identifying a set of one or more historical key values includes using one or more key values that were indicated as being the current value in one or more previous instances.

6. The method of claim 1, further comprising the step of detecting that the object has intersected the region, and wherein the step of determining a position includes determining that the position of the object is near or on a boundary of one or more designated area in the region, wherein each designated area delineates one of the key values in the set of key values.

7. The method of claim 1, wherein determining a displacement characteristic includes determining a displacement of the object in relation to a surface of the region where the virtual interface is provided.

8. The method of claim 5, wherein the step of using one or more key values that were indicated as being the current value in one or more previous instances includes using alphabet characters from the keyboard that were indicated as being the current key values in the one or more previous instances.

9. The method of claim 1, wherein the step of using alphabet characters includes using lexicographic information.

10. The method of claim 1, wherein the step of determining the shape characteristic includes determining whether a shape of the object corresponds to any one of a stylus or a finger.

11. The method of claim 10, wherein the step of determining the shape characteristic includes determining whether a shape of the object corresponds to any one of a stylus tip, finger tip, or unknown shape.

12. An electronic device for providing a virtual interface, the electronic device comprising:

a position sensor configured to determine a position of an object that has intersected a region where the virtual interface is provided, where the position includes at least one coordinate that is based on a depth of the object from the sensor; and

a processor configured to;

identify a set of one or more historical key values that are pertinent to the current key value;

determine at least one of (i) a displacement characteristic of the object or (ii) a shape characteristic of object; and

indicate a probability that the current key value is a particular one or more of the key values in the set of key values based on the position, the set of one or more historical key values, and the at least one of the displacement characteristic or the shape characteristic.

13. The electronic device of claim 12, wherein the processor is configured indicate, to for each particular key value in the set of key values, that the particular key value is the current key value.

14. The electronic device of claim 12, wherein the processor is configured to provide an external electronic device with data corresponding to the likelihood that each key value in the set of key values is the current key value.

15. The electronic device of claim 12, further comprising a light-source configured to project a light-generated keyboard over a surface, and wherein the position sensor is configured to monitora portion of the surface where the light-generated keyboard is provided in order to detect contact between any object and the surface.

16. A method for providing feedback as to an input selected by a user through an input interface, the method comprising:

detecting that an object intersects an area where the input interface is provided;

determining a position of the object when the object intersects the area;

identifying a set of one or more possible input selections corresponding to the contact based at least in part on the position, including at least a first input selection in the set that is identified as corresponding to the contact between the object and the surface;

determining a probability indication for at least the first input selection;

generating a first sound to indicate that the probability indication for at least the first input selection is below a threshold level, the probability indication indicating that the identification of at least the first input selection is ambiguous.

17. The method of claim 16, further comprising the step of determining a second position of the object when the object intersects the area a second time, and generating a second sound to indicate that the probability indication for at least the second input selection is below the threshold level.

18. The method of claim 17, wherein the first sound and the second sound have a similar harmonic.

19. The method of claim 17, wherein determining a probability indication for at least the first input includes determining at least one of (i) a displacement characteristic of the object or (ii) a shape characteristic of object.

20. The method of claim 17, wherein determining a shape characteristic of object includes distinguishing the object as being one of a stylus, a finger, or something else.