Input apparatus and methods having diffuse and specular tracking modes

• US 7,675,020 B2
• Filed: 08/28/2006
• Issued: 03/09/2010
• Est. Priority Date: 08/28/2006
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Inventors: Machida, Akihiro
• Primary Examiner(s): Epps, Georgia Y
• Assistant Examiner(s): BUI PHO, PASCAL M
• Application Number:
  US11/510,890
• Publication Number:
  US 20080061220A1
• Time in Patent Office: 1,289 Days
• Field of Search: 250/221, 250/559.32, 250/559.04, 250/559.29, 250/559.36, 345157-167, 356/498, 356337-343, 356/612, 356/614
• US Class Current: 250/221
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface

Abstract

Input apparatus and methods are described. An object is illuminated with output light. Diffuse reflections of the output light from the object are captured. Diffuse reflection optical data is produced from the captured diffuse reflections. Specular reflections of the output light from the object are captured. Specular reflection optical data is produced from the captured specular reflections. A first set of motion measures indicative of movement in relation to the object is produced from the diffuse reflection optical data. A second set of motion measures indicative of movement in relation to the object is produced from the specular reflection optical data.

Claims

1. An input apparatus, comprising:

an illumination system operable to illuminate an object with output light;

a diffuse reflection capture system operable to capture diffuse reflections of the output light from the object and produce diffuse reflection optical data from the captured diffuse reflections;

a specular reflection capture system operable to capture specular reflections of the output light from the object and produce specular reflection optical data from the captured specular reflections; and

a processing system operable to produce a first set of motion measures indicative of movement of the input apparatus in relation to the object from the diffuse reflection optical data and to produce a second set of motion measures indicative of movement of the input apparatus in relation to the object from the specular reflection optical data, wherein the processing system is operable to select one of a diffuse reflection tracking state and a specular reflection tracking state based on an assessment of a tracking quality of light received by at least one of the diffuse reflection capture system and the specular reflection capture system, wherein the processing system outputs motion measures in the first set during the diffuse reflection tracking state whereas the processing system outputs motion measures in the second set during the specular reflection tracking state.

2. The input apparatus of claim 1, further comprising a housing containing the illumination system, the diffuse reflection capture system, and the specular reflection capture system, wherein the housing comprises a registration surface, the illumination system is configured to direct at least one output light beam out of the housing along an outgoing beam path at an acute angle θ

_OUT greater than zero relative to a normal direction perpendicular to the registration surface, the specular reflection capture system is configured to capture at least a portion of the output light beam specularly reflected from the object into the housing along an incoming beam path at an angle θ

_S relative to the normal direction that is equal to θ

_OUT.

3. The input apparatus of claim 2, wherein the diffuse reflection capture system is configured to capture at least a portion of the output light beam diffusely reflected from the object into the housing along a range of incoming beam paths including the normal direction.

4. The input apparatus of claim 1, wherein the diffuse reflection capture system is operable to capture images of the diffuse reflections, and the processing system produces motion measures in the first set from comparisons of ones of the images captured by the diffuse reflection capture system.

5. The input apparatus of claim 1, wherein the specular reflection capture system is operable to capture images of the specular reflections, and the processing system is operable to determine motion measures in the second set from blurred images of specularly reflected light beams in respective ones of the images captured by the specular reflection capture system.

6. The input apparatus of claim 5, wherein the processing system is operable to determine features of intra-exposure traces of the specularly reflected light beams corresponding to the blurred images and to determine motion measures in the second set from the determined features.

7. The input apparatus of claim 6, wherein the processing system controls a rate at which the specular reflection capture system captures images of the specular reflections in response to comparisons of ones of the determined features to a threshold.

8. The input apparatus of claim 1, wherein the processing system is operable to select one of the diffuse reflection tracking state and the specular reflection tracking state based on at least one tracking quality measure.

9. The input apparatus of claim 8, wherein the diffuse reflection capture system is operable to capture images of the diffuse reflections, and the processing system derives saliency measures from images captured by the diffuse reflection capture system and determines the at least one tracking quality measure from the saliency measures.

10. The input apparatus of claim 1, wherein the specular reflection capture system comprises:

an image sensor having a capture plane;

a pendular element comprising an optical element operable to focus the captured specular reflections onto a region of the capture plane; and

an elastic restraint coupling the pendular element to a support and operable to apply to the pendular element a restraining force that opposes movement of the pendular element in at least a first direction;

wherein movement of the pendular element moves the region in the capture plane where the optical element focuses the capture specular reflections.

11. The input apparatus of claim 1, wherein the illumination system comprises a laser that produces a laser beam and an optical system that is operable to produce the output light from at least a portion of the laser beam, and the specular reflection capture system comprises an interferometer that mixes the specular reflections with reference light derived from the laser beam to produce an interferometer output signal, and the processing system produces motion measures in the first set from the interferometer output signal.

12. The input apparatus of claim 1, wherein the illumination system comprises a laser that produces a laser beam and an optical system that is operable to produce the output light from at least a portion of the laser beam, and the diffuse reflection capture system comprises an interferometer that mixes the diffuse reflections with reference light derived from the laser beam to produce an interferometer output signal, and the processing system produces motion measures in the second set from the interferometer output signal.

13. The input apparatus of claim 1, wherein the illumination system comprises a laser that produces a laser beam and an optical system that is operable to produce the output light from at least a portion of the laser beam, and the diffuse reflection capture system comprises an optical system that directs the diffuse reflections into a self-mixing cavity of the laser, the laser additionally produces a second laser beam, the diffuse reflection capture system additionally comprises a light sensor that produces a detection signal from the second laser beam, and the processing system produces motion measures in the first set from the detection signal.

14. The input apparatus of claim 1, wherein the illumination system comprises a light source that produces source light and a mask that modifies the source light to produce the output light having a spot light portion that illuminates an area of the object and a peripheral light portion that illuminates areas of the object adjacent the area illuminated by the spot light portion.

15. The input apparatus of claim 14, wherein the mask modifies the source light such that the spot light portion illuminates a first region of the object with a first average light intensity and the peripheral light portion illuminates a second region of the object with a second average light intensity lower than the first average light intensity.

16. The input apparatus of claim 15, wherein the mask modifies the source light to produce the output light having a transverse cross section with the spot light portion in a central region and the peripheral light portion comprising multiple light beams distributed in a peripheral region around the spot light portion.

17. The input apparatus of claim 14, wherein the light source is a light-emitting diode and the mask comprises a stencil.

18. The input apparatus of claim 14, wherein the light source is a laser and the mask comprises a hologram.

19. The input apparatus of claim 1, wherein the processing system is further configured to:

derive a saliency measure from the diffuse reflection optical data, wherein the saliency measure indicates a visual quality of the captured diffuse reflections;

determine an intensity of the captured specular reflections based on the specular reflection optical data and compare the intensity of the captured specular reflections with an intensity threshold; and

perform the assessment of the tracking quality of light based on the saliency measure corresponding to the diffuse reflection optical data and the intensity corresponding to the specular reflection optical data.

20. An input system, comprising:

means for illuminating an object with output light;

means for capturing diffuse reflections of the output light from the object;

means for producing diffuse reflection optical data from the captured diffuse reflections;

means for capturing specular reflections of the output light from the object;

means for producing specular reflection optical data from the captured specular reflections;

means for producing a first set of motion measures indicative of movement of the input system in relation to the object from the diffuse reflection optical data;

means for producing a second set of motion measures indicative of movement of the input system in relation to the object from the specular reflection optical data;

means for selecting a diffuse reflection tracking state or a specular reflection tracking state based on an assessment of a tracking quality of light corresponding to at least one of the diffuse reflection optical data or the specular reflection optical data; and

means for outputting motion measures in either the first set during the diffuse reflection tracking state or the second set during the specular reflection tracking state.

21. A method for determining relative motion between an input device and an object, the method comprising:

illuminating the object with output light;

capturing diffuse reflections of the output light from the object;

producing diffuse reflection optical data from the captured diffuse reflections;

capturing specular reflections of the output light from the object;

producing specular reflection optical data from the captured specular reflections;

producing a first set of motion measures indicative of movement of the input device in relation to the object from the diffuse reflection optical data;

producing a second set of motion measures indicative of movement of the input device in relation to the object from the specular reflection optical data;

selecting a diffuse reflection tracking state or a specular reflection tracking state based on an assessment of a tracking quality of light corresponding to at least one of the diffuse reflection optical data or the specular reflection optical data; and

outputting motion measures in either the first set during the diffuse reflection tracking state or the second set during the specular reflection tracking state.