Computer vision-based object tracking system

• US 9,964,624 B2
• Filed: 07/18/2014
• Issued: 05/08/2018
• Est. Priority Date: 05/23/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Wilson, Andrew D.
• Primary Examiner(s): Li, Tracy Y
• Application Number:
  US14/334,846
• Publication Number:
  US 20140327784A1
• Time in Patent Office: 1,390 Days
• CPC Class Codes: G01S 3/7864 T.V. type tracking systems
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06V 10/62 relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
• CPC Class Codes: H04N 23/20 for generating image signals from infrared radiation only
• CPC Class Codes: H04N 25/443 by reading pixels from selected 2D regions of the array, e.g. for windowing or digital zooming
• CPC Class Codes: H04N 25/47 Image sensors with pixel address output; Event-driven image sensors; Selection of pixels to be read out based on image data
• CPC Class Codes: H04N 25/76 Addressed sensors, e.g. MOS or CMOS sensors
• CPC Class Codes: H04N 3/155 Control of the image-sensor operation, e.g. image processing within the image-sensor
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A computer-implemented method for utilizing a camera device to track an object is presented. As part of the method, a region of interest is determined within an overall image sensing area. A point light source is then tracked within the region of interest. In a particular arrangement, the camera device incorporates CMOS image sensor technology and the point light source is an IR LED. Other embodiments pertain to manipulations of the region of interest to accommodate changes to the status of the point light source.

Claims

1. A vision-based gaming system comprising:

an optical device configured to receive light from a light source associated with a user game controller; and

a computing device configured to;

track movement of the user game controller within an image sensing area based on the light received from the light source,

wherein the optical device has a variable field of vision such that the computing device is configured to track movement of the light source at multiple different distances from the optical device, wherein the variable field of vision is variable between a first field of vision and a second field of vision that has a larger area than the first field of vision; and

adjust an acquisition rate of frames from the optical device, wherein the acquisition rate is proportional to a resolution of the images from the optical device.

2. The vision-based gaming system of claim 1, wherein the user game controller comprises a handheld device having one or more user input controls.

3. The vision-based gaming system of claim 1, further comprising an interface for communicatively coupling the optical device to a processor of the vision-based gaming system.

4. The vision-based gaming system of claim 1, wherein the optical device comprises a camera.

5. The vision-based gaming system of claim 4, wherein the camera comprises a CMOS image sensor.

6. The vision-based gaming system of claim 1, wherein the light source is configured to produce the light received by the optical device.

7. The vision-based gaming system of claim 6, wherein the light source comprises a light emitting diode (LED).

8. The vision-based gaming system of claim 1, wherein the optical device is configured to detect infrared (IR) light emitted from the light source.

9. The vision-based gaming system of claim 1, wherein the computing device is configured to:

determine a boundary of a region of interest within the image sensing area based at least in part upon a potential range of movement of the point light source, wherein the boundary of the region of interest defines an area that is less than the image sensing area.

10. The vision-based gaming system of claim 9, wherein the computing device is configured to:

determine the potential range of movement of the point light source based on a location of the tracked movement and a given time period for potential movement of the point light source.

11. The vision-based gaming system of claim 10, wherein the computing device is configured to

re-determine the boundary of the region of interest when the light source moves to a location that is beyond a predetermined threshold, and wherein the predetermined threshold is based upon a number of frames.

12. The vision-based gaming system of claim 10, wherein the computing device is configured to:

determine that the light source is not detected within the boundary of the region of interest and in response, adjust the boundary to increase the size of the region of interest.

13. The vision-based gaming system of claim 1, wherein the optical device comprises an imaging component that is adjustable to vary the field of vision of the optical device from the first field of vision to the second field of vision.

14. The vision-based gaining system of claim 13, wherein the imaging component comprises at least one lens and varying the field of vision comprises adjusting the focus of the at least one lens.

15. The vision-based gaming system of claim 13, wherein the imaging component is adjusted automatically by sending an instruction through an interface that communicatively couples the optical device and a gaining console.

16. A computer-implemented method in a vision-based gaming system, the method comprising:

receiving a first signal from an optical device in the vision-based gaming system, the first signal being indicative of the optical device receiving, with a first field of vision, light from a light source that is associated with a user game controller such that the light source moves as the user game controller moves,

wherein the optical device is configured to track the light source at multiple different distances from the optical device;

determining a first movement of the user game controller based on the first signal;

receiving a second signal from the optical device, the second signal being indicative of the optical device receiving, with a second field of vision that defines a larger spatial area than the first field of vision, light from the light source to; and

determining a second movement of the user game controller based on the second signal;

wherein an acquisition rate of frames from the optical device is adjustable, and the acquisition rate is proportional to a resolution of the images from the optical device.

17. The computer-implemented method of claim 16, wherein the user game controller comprises a handheld device having one or more user input controls.

18. The computer-implemented method of claim 16, wherein the optical device comprises a camera.

19. The computer-implemented method of claim 16, wherein the light source is configured to produce the light received by the optical device.

20. The computer-implemented method of claim 19, wherein the light source comprises a light emitting diode (LED).