Object detection using video input combined with tilt angle information

• US 8,781,151 B2
• Filed: 08/16/2007
• Issued: 07/15/2014
• Est. Priority Date: 09/28/2006
• Status: Expired

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Marks, Richard, Zalewski, Gary M.
• Primary Examiner(s): TUCKER, WESLEY J
• Application Number:
  US11/840,170
• Publication Number:
  US 20080080789A1
• Time in Patent Office: 2,525 Days
• Field of Search: 382/128, 382/131, 382/132, 382/296, 463/36, 463/37, 463/38, 345/161, 345/156
• US Class Current: 382/100
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device

Abstract

A method for use in obtaining input data from an object includes capturing a live image of the object with an image capture device, receiving information related to a tilt angle of the object from one or more sensors other than the image capture device, using the information related to a tilt angle of the object to obtain at least one rotated reference image of the object, comparing the live image of the object with the rotated reference image of the object, and generating an indication in response to the live image matching the rotated reference image. An apparatus and a storage medium storing a computer program executable by a processor based system are also disclosed.

Claims

1. A method for use in obtaining input data from an object, comprising:

capturing a live image of the object with an image capture device;

receiving information related to a tilt angle of the object from one or more sensors other than the image capture device;

using the information related to a tilt angle of the object to obtain at least one rotated reference image of the object;

comparing the live image of the object with the rotated reference image of the object; and

generating an indication in response to the live image matching the rotated reference image.

2. A method in accordance with claim 1, wherein the one or more sensors other than the image capture device comprises a gyro sensor in the object.

3. A method in accordance with claim 1, wherein the one or more sensors other than the image capture device comprises an accelerometer in the object.

4. A method in accordance with claim 1, wherein the rotated reference image of the object is obtained by retrieving it from storage.

5. A method in accordance with claim 1, wherein the rotated reference image of the object is obtained by rotating a reference image of the object.

6. A method in accordance with claim 1, further comprising:

passing the live image of the object and the rotated reference image of the object through a normalizing filter.

7. A method in accordance with claim 1, wherein the image capture device comprises a camera.

8. A method in accordance with claim 1, wherein the image capture device comprises a Z-camera.

9. A method in accordance with claim 1, wherein the object comprises a hand-held controller.

10. A method in accordance with claim 1, wherein the information relating to the tilt angle of the object is used to obtain a plurality of rotated reference images of the object, and the live image of the object is compared with each of the plurality of rotated reference images of the object.

11. An apparatus for use in obtaining input data from an object, comprising:

an image capture device configured to capture a live image of the object; and

a processor based system configured to receive information related to a tilt angle of the object from one or more sensors other than the image capture device, use the information related to a tilt angle of the object to obtain at least one rotated reference image of the object, compare the live image of the object with the rotated reference image of the object, and generate an indication in response to the live image matching the rotated reference image.

12. An apparatus in accordance with claim 11, wherein the one or more sensors other than the image capture device comprises a gyro sensor in the object.

13. An apparatus in accordance with claim 11, wherein the one or more sensors other than the image capture device comprises an accelerometer in the object.

14. An apparatus in accordance with claim 11, wherein the rotated reference image of the object is obtained by retrieving it from storage.

15. An apparatus in accordance with claim 11, wherein the rotated reference image of the object is obtained by rotating a reference image of the object.

16. An apparatus in accordance with claim 11, wherein the processor based system is further configured to pass the live image of the object and the rotated reference image of the object through a normalizing filter.

17. An apparatus in accordance with claim 11, wherein the image capture device comprises a camera.

18. An apparatus in accordance with claim 11, wherein the object comprises a hand-held controller.

19. An apparatus in accordance with claim 11, wherein the information relating to the tilt angle of the object is used to obtain a plurality of rotated reference images of the object, and the live image of the object is compared with each of the plurality of rotated reference images of the object.

20. A non-transitory computer readable storage medium storing a computer program executable by a processor based system, the computer program causing the processor based system to execute steps comprising:

receiving a captured live image of an object from an image capture device;

receiving information related to a tilt angle of the object from one or more sensors other than the image capture device;

using the information related to a tilt angle of the object to obtain at least one rotated reference image of the object;

comparing the live image of the object with the rotated reference image of the object; and

generating an indication in response to the live image matching the rotated reference image.

21. A storage medium in accordance with claim 20, wherein the one or more sensors other than the image capture device comprises a gyro sensor in the object.

22. A storage medium in accordance with claim 20, wherein the one or more sensors other than the image capture device comprises an accelerometer in the object.

23. A storage medium in accordance with claim 20, wherein the rotated reference image of the object is obtained by retrieving it from storage.

24. A storage medium in accordance with claim 20, wherein the rotated reference image of the object is obtained by rotating a reference image of the object.

25. A storage medium in accordance with claim 20, wherein the computer program is further configured to cause the processor based system to execute a step comprising:

passing the live image of the object and the rotated reference image of the object through a normalizing filter.

26. A storage medium in accordance with claim 20, wherein the image capture device comprises a camera.

27. A storage medium in accordance with claim 20, wherein the image capture device comprises a Z-camera.

28. A storage medium in accordance with claim 20, wherein the object comprises a hand-held controller.

29. A storage medium in accordance with claim 20, wherein the information relating to the tilt angle of the object is used to obtain a plurality of rotated reference images of the object, and the live image of the object is compared with each of the plurality of rotated reference images of the object.