System and method for interactive three-dimensional position tracking

• US 7,978,174 B2
• Filed: 06/07/2006
• Issued: 07/12/2011
• Est. Priority Date: 06/07/2006
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Inventors: Lim, Soo Sean, Venkatesh, Shalini, Chan, Lye Hock Bernard, Liew, Tong Sen, Itagaki, Nobutaka
• Primary Examiner(s): Shalwala, Bipin
• Assistant Examiner(s): Abebe, Sosina
• Application Number:
  US11/449,263
• Publication Number:
  US 20070285386A1
• Time in Patent Office: 1,861 Days
• Field of Search: 345156-184, 463 30- 472
• US Class Current: 345/157
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A system and method for tracking the x, y and z coordinates of a position of an input device in an interactive computer system is disclosed. An image sensor situated on the input device captures images of an electronic marker displayed on a display screen. As the position of the input device changes, the features of the electronic marker as captured by the image sensor also change. Images of the electronic marker captured during game play are compared to a calibration image of the electronic marker to determine current x, y and z coordinates of positions of the input device. The game display is updated to reflect the movements of the input device.

Claims

1. A method of tracking a position of an input device for an interactive electronic system comprising:

displaying an electronic marker on a display screen;

capturing a calibration image of said electronic marker using an image sensor of the input device positioned at a calibration position with respect to said display screen;

assigning calibration x, y and z coordinates based on an appearance of said electronic marker in said calibration image to establish said calibration position of said input device, including using a separation of features of said electronic marker in said calibration image to determine the distance between said input device and said display screen to assign said calibration z coordinate;

displaying a first series of program frames on a display screen without displaying said electronic marker, wherein said first series of frames depict a view of a program from said calibration position;

displaying said electronic marker on said display screen after said displaying of said first series of program frames on said display screen;

capturing a first image of said electronic marker using said image sensor of said input device positioned at a first relative position with respect to said calibration position;

calculating said first relative position of said input device comprising x, y and z coordinates using said first image of said electronic marker; and

displaying a second series of program frames on said display screen without displaying said electronic marker, wherein said second series of frames depict a view of said program from said first relative position.

2. The method described in claim 1 wherein said calculating said first relative position is accomplished by comparing said first image with said calibration image using cross-correlation.

3. The method described in claim 1 wherein said image sensor is a navigation sensor.

4. The method described in claim 3 wherein said navigation sensor is a flying mouse.

5. The method described in claim 1 wherein said display screen is a television screen.

6. The method described in claim 1 wherein said display screen is a computer screen.

7. The method described in claim 1 wherein said display screen is a video arcade game monitor.

8. The method described in claim 1 wherein said first series of visual frames comprises 30 frames.

9. The method described in claim 1 wherein said displaying said electronic marker displaying said electronic marker for a fraction of a second so that said electronic marker is not user-detectable.

10. The method described in claim 1 wherein said electronic marker comprises a row of alternating black and white squares.

11. The method described in claim 1 wherein said program is a game.

12. An interactive electronic system comprising:

an input device comprising an image sensor, wherein a first image of an electronic marker flashed on a display screen and generated by a controller is captured by said image sensor, and wherein said first image is used to assess x, y and z coordinates of a calibration position of said input device with respect to said display screen, including using a separation of features of said electronic marker in said first image to determine the distance between said input device and said display screen to assess said z coordinate of said calibration position, wherein a second image of said electronic marker captured by said image sensor is used by a cross correlating component to calculate x, y and z coordinates of a relative position of said input device, wherein said position of said input device is tracked according to the following method;

displaying a first series of frames on screen display screen without displaying said electronic marker, wherein said first series of frames depict a view of a game from said calibration position;

capturing said second image;

comparing said second image with said first image;

calculating a first relative position of said input device comprising x, y and z coordinates; and

displaying a second series of frames on said monitor without displaying said electronic marker, wherein said second series of frames depict a view of said game from said first relative position.

13. The system of claim 12 wherein said image sensor is a navigation sensor.

14. The system of claim 12 wherein said navigation sensor is a flying mouse.

15. The system of claim 12 wherein said controller and said input device are connected by a wireless link.

16. The system of claim 12 wherein said controller and said input device are connected by a cord.

17. The system of claim 12 wherein said display screen is a cathode ray tube.

18. The system of claim 12 wherein said display screen is a computer screen.

19. The system of claim 12 wherein said display screen is a video arcade game monitor.

20. The system of claim 12 wherein said system is configured to display said electronic marker on said display screen for a fraction of a second so that said electronic marker is not user-detectable.