COMPUTER INPUT DEVICE

• US 20110043446A1
• Filed: 05/05/2009
• Published: 02/24/2011
• Est. Priority Date: 05/02/2008
• Status: Abandoned Application

• Current Assignee: University of Teeside
• Original Assignee: University of Tennessee
• Inventors: Brunton, Timothy, Spears, Iain, Tang, Wen
• Application Number:
  US12/990,769
• Publication Number:
  US 20110043446A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

Computer input apparatus comprising: an image capture device; and a marker member comprising at least two reference indicia, at least a first reference indicium being arranged to emit or reflect light having a first spectral characteristic, and at least a second reference indicium being arranged to emit or reflect light having a second spectral characteristic different from the first spectral characteristic, the image capture device being arranged to distinguish light of said first spectral characteristic from light of said second spectral characteristic thereby to distinguish the at least a first reference indicium from the at least a second reference indicium, the apparatus being configured to capture an image of the at least two reference indicia and to determine by means of said image a position and orientation of the marker member with respect to a reference frame.

Claims

1. Computer input apparatus comprising:

an image capture device; and

a marker member comprising at least two reference indicia,

at least a first reference indicium being arranged to emit or reflect light having a first spectral characteristic, and

at least a second reference indicium being arranged to emit or reflect light having a second spectral characteristic different from the first spectral characteristic,

the image capture device being arranged to distinguish light of said first spectral characteristic from light of said second spectral characteristic thereby to distinguish the at least a first reference indicium from the at least a second reference indicium,

the apparatus being configured to capture an image of the at least two reference indicia and to determine by means of said image a position and orientation of the marker member with respect to a reference frame.

2. Apparatus as claimed in claim 1 wherein light of the first spectral characteristic corresponds to light of a first colour and light of the second spectral characteristic corresponds to light of a second colour different from the first colour.

3. Apparatus as claimed in claim 2 wherein the first and second colours are each a different one selected from amongst red, green and blue.

4. Apparatus as claimed in any preceding claim comprising at least a third reference indicium arranged to emit or reflect light of a third spectral characteristic.

5. Apparatus as claimed in claim 4 wherein the third spectral characteristic corresponds substantially to the first or second spectral characteristics.

6. Apparatus as claimed in claim 4 wherein the third spectral characteristic is sufficiently different from the first and second spectral characteristics to be distinguishable by the image capture device from indicia emitting or reflecting light of the first or second spectral characteristics.

7. Apparatus as claimed in claim 5 or claim 6 wherein the third spectral characteristic corresponds to a colour.

8. Apparatus as claimed in claim 7 wherein the colour is one selected from amongst red, green and blue.

9. Apparatus as claimed in claim 8 depending through claim 3 wherein light of the first, second and third spectral characteristics each corresponds to a different respective colour.

10. Apparatus as claimed in claim 4 or any of claims 5 to 9 depending through claim 4 wherein the first, second and third reference indicia are arranged to non-colinear.

11. Apparatus as claimed in any preceding claim wherein the image capture device is provided with a plurality of detector elements,

a first detector element being responsive to wavelengths in a first range of wavelengths, the apparatus being operable to acquire a first image by means of the first detector element, and

a second detector element being responsive to wavelengths in a second range of wavelengths different from the first range of wavelengths,

the apparatus being operable to acquire a second image by means of the second detector element, wherein the first range of wavelengths includes at least some wavelengths of the first spectral characteristic and the second range of wavelengths includes at least some wavelengths of the second spectral characteristic.

12. Apparatus as claimed in claim 11 arranged whereby the first spectral characteristic and the first and second ranges of wavelengths are selected such that for a given intensity of light emitted or reflected by the at least a first indicium, an intensity of light detected by the first detector element from the at least a first indicium is greater than an intensity of light detected by the second detector element from the at least a first indicium.

13. Apparatus as claimed in claim 11 or claim 12 arranged whereby the second spectral characteristic and the first and second ranges of wavelengths are selected such that for a given intensity of light emitted or reflected by the at least a second indicium, an intensity of light detected by the second detector element from the at least a second indicium is greater than an intensity of light detected by the first detector element from the at least a second indicium.

14. Apparatus as claimed in any one of claims 11 to 13 arranged to determine a position in the first image of a centroid of a portion of the first image corresponding to the at least a first indicium and a position in the second image of a centroid of a portion of the second image corresponding to the at least a second indicium.

15. Apparatus as claimed in any one of claims 11 to 14 depending through claim 4 wherein the image capture device comprises a third detector element responsive to wavelengths in a third range of wavelengths and arranged to capture a third image, the third range of wavelengths including at least some wavelengths of the third spectral characteristic.

16. Apparatus as claimed in claim 15 depending through claim 12 or 13 arranged whereby

the first spectral characteristic and the first, second and third ranges of wavelengths are selected such that for a given intensity of light emitted or reflected by the at least a first indicium, an intensity of light detected by the first detector element from the at least a first indicium is greater than an intensity of light detected by the second or third detector elements from the at least a first indicium;

the second spectral characteristic and the first, second and third ranges of wavelengths are selected such that for a given intensity of light emitted or reflected by the at least a second indicium, an intensity of light detected by the second detector element from the at least a second indicium is greater than an intensity of light detected by the first or third detector elements from the at least a second indicium; and

the third spectral characteristic and the first, second and third ranges of wavelengths are selected such that for a given intensity of light emitted or reflected by the at least a third indicium, an intensity of light detected by the third detector element from the at least a third indicium is greater than an intensity of light detected by the first or second detector elements from the at least a third indicium.

17. Apparatus as claimed in any preceding claim wherein one reference indicium is arranged to be of a larger area another reference indicium whereby occlusion of an image of the one reference indicia by the other reference indicium may be substantially avoided.

18. Apparatus as claimed in any preceding claim wherein the apparatus is configured to detect an area of overlap in an image of two or more of the indicia by determining a location of any area of increase in light intensity in a captured image due to overlap of indicia.

19. Apparatus as claimed in claim 18 arranged to determine a centroid of an area of the captured image corresponding to one of the indicia by reference to any said area of overlap between the area corresponding to the one indicium and an area corresponding to another indicium, and an area of the image corresponding to said one of the indicia that is not overlapping an area corresponding to said another one of the indicia.

20. Apparatus as claimed in any preceding claim wherein the marker member is arranged to be held in a hand of a user.

21. Apparatus as claimed in any preceding claim wherein the marker member is arranged to be attached to a user.

22. Apparatus as claimed in claim 20 or claim 21 wherein the marker member is arranged to be positioned whereby a pair of the reference indicia are provided in a mutually spaced apart configuration substantially coincident with an axis of rotation of an anatomical joint.

23. Apparatus as claimed in claim 22 wherein the marker member is arranged whereby the first and second reference indicia are provided in the mutually spaced apart configuration substantially coincident with the axis of rotation of the anatomical joint.

24. Apparatus as claimed in claim 22 or 23 wherein the axis of rotation corresponds to an abduction-adduction axis of the wrist.

25. Apparatus as claimed in claim 22 or 23 wherein the axis of rotation corresponds to one selected from amongst a carpo-1^st metacarpal joint and a second metacarpal-phalangeal joint.

26. Apparatus as claimed in any preceding claim wherein the image capture device is provided with a polarising element arranged to reduce an amount of light incident on a detector of the image capture device.

27. Apparatus as claimed in any preceding claim wherein at least one of the reference indicia comprises a light source.

28. Apparatus as claimed in any preceding claim wherein each of the reference indicia comprises a light source.

29. Apparatus as claimed in any preceding claim wherein a size of an area of the image captured by the apparatus corresponding to one or more of the reference indicia is expanded relative to a corresponding area of a portion of an image of the reference indicia that would be obtained under in-focus conditions whereby a position of a centroid of each of the one or more reference indicia in the image may be determined with increased precision.

30. Apparatus as claimed in claim 29 wherein expansion of the area of the image corresponding to the one or more of reference indicia is obtained by defocus of the image.

31. Apparatus as claimed in claim 30 wherein defocus of the image is performed by optical means.

32. Apparatus as claimed in claim 30 or 31 wherein defocus of the image is performed electronically.

33. Apparatus as claimed in any preceding claim wherein an intensity of light emitted or reflected by at least one of the indicia may be changed whereby the apparatus is able to identify which indicium a portion of an image corresponds to by means of a prescribed change in intensity of light emitted or reflected by the at least one of the indicia.

34. Apparatus as claimed in any preceding claim comprising a plurality of image capture devices.

35. Apparatus as claimed in claim 34 wherein at least a first image capture device is arranged to capture an image from a region of space not captured by at least a second image capture device.

36. Apparatus as claimed in claim 35 wherein the regions of space captured by the at least a first image capture device and the at least a second image capture device have at least a portion in common.

37. Computer input apparatus comprising

an image capture device;

and

a marker member comprising at least three non-colinear reference indicia, the marker member being arranged to be held by a user or attached to a body of a user such that a pair of reference indicia are provided in a mutually spaced apart configuration substantially coincident with an anatomical axis of rotation of a joint of the user,

the apparatus being configured to capture an image of the reference indicia and to determine a position and orientation of the marker member with respect to a reference position.

38. Apparatus as claimed in claim 37 wherein the structure is arranged such that one of each of the pair of reference indicia are provided at locations substantially coincident with the axis of rotation, the pair of reference indicia being axially spaced with respect to one another.

39. Apparatus as claimed in any one of claim 37 or 38 wherein the anatomical axis of rotation corresponds to an abduction-adduction axis of the wrist.

40. Apparatus as claimed in any one of claims 37 to 39 wherein the anatomical axis of rotation corresponds to a carpo-1^st metacarpal joint.

41. Apparatus as claimed in any one of claims 37 to 40 wherein the anatomical axis of rotation corresponds to a second metacarpal-phalangeal joint.

42. Apparatus as claimed in any one of claims 37 to 41 arranged to be held in a hand of the user.

43. Apparatus as claimed in any one of claims 37 to 42 arranged to be attached to a head of the user.

44. Apparatus as claimed in any one of claims 37 to 43 comprising a plurality of marker members.

45. Apparatus as claimed in claim 44 comprising a pair of marker members arranged to be held in respective left and right hands of the user.

46. Apparatus as claimed in claim 44 or claim 45 comprising at least one marker member arranged to be held in a hand of the user and a marker member arranged to be supported on a head of the user.

47. Apparatus as claimed in any one of claims 37 to 46 wherein the apparatus is further configured such that a size of an area of the image captured by the apparatus corresponding to one or more of the reference indicia is expanded relative to a corresponding area of a portion of an image of the reference indicia that would be obtained under in-focus conditions whereby a position of the centroid of each of the one or more reference indicia in the image may be determined with increased precision.

48. Apparatus as claimed in claim 47 wherein expansion of the area of the image occupied by the at least one indicia is obtained by defocus of the image.

49. Apparatus as claimed in claim 48 wherein defocus of the image is performed by optical means.

50. Apparatus as claimed in claim 48 or 49 wherein defocus of the image is performed electronically.

51. Apparatus as claimed in any one of claims 37 to 50 wherein at least one of the reference indicia comprises a light source.

52. Apparatus as claimed in claim 51 wherein the at least three non-colinear reference indicia are provided by a first light source, a second light source and a third light source, respectively.

53. Apparatus substantially as hereinbefore described with reference to the accompanying drawings.