Apparatus and method for object positioning

• US 9,129,446 B2
• Filed: 08/06/2013
• Issued: 09/08/2015
• Est. Priority Date: 08/17/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Europe Limited (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Europe Limited (Sony Group Corp.)
• Inventors: Campbell, Diarmid Archibald, Lucas-Woodley, Thomas, Lord, Nicholas Andrew, Sykes, William Oliver
• Primary Examiner(s): Wu, Xiao
• Assistant Examiner(s): Lhymn, Sarah
• Application Number:
  US13/960,378
• Publication Number:
  US 20140049560A1
• Time in Patent Office: 763 Days
• Field of Search: 345/632, 345/633, 345/634, 345/635, 345/636, 345/637, 345/418, 345/419, 345/420
• US Class Current: 1/1
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/74 involving reference images or patches

Abstract

An entertainment device comprises an input, a marker detector and a failure boundary calculation processor. The input is operable to receive a captured image from a video camera. The marker detector is operable to detect a fiduciary marker within the captured image, and is also operable to estimate a distance and angle of the fiduciary marker. The failure boundary calculation processor is operable to calculate at least one of an additional distance and an additional angle from the currently estimated distance and angle of the fiduciary marker at which recognition of the fiduciary marker is assumed to fail.

Claims

1. An entertainment device, comprising:

an input operable to receive a captured image from a video camera;

a marker detector operable to detect a fiduciary marker within the captured image, and operable to estimate a distance and angle of the fiduciary marker; and

a failure boundary calculation processor operable to calculate at least one of an additional distance and an additional angle from the estimated distance and angle of the fiduciary marker as a failure boundary at which recognition of the fiduciary marker is assumed to fail;

in which the failure boundary comprises a video camera frustrum and a circle having a diameter equal to a maximum distance at which the fiduciary marker can be recognised, the circle intersecting an image plane of the video camera and having an angle with respect to the image plane of the video camera that is the same as that of the fiduciary marker.

2. An entertainment device according to claim 1, comprising:

a warning boundary calculation processor operable to calculate whether the estimated distance and angle of the marker lies within at least one of a threshold distance and threshold angle from the failure boundary.

3. An entertainment device according to claim 2, comprising

an image augmentation processor operable to augment the captured image responsive to whether the fiduciary marker is calculated to lie within the warning boundary.

4. An entertainment device according to claim 3, in which

the image augmentation processor indicates a restorative motion of the fiduciary marker that would take the fiduciary marker back out of the warning boundary.

5. A method of object positioning, comprising the steps of:

receiving a captured image from a video camera;

detecting a fiduciary marker within the captured image;

estimating a distance and angle of the fiduciary marker; and

calculating at least one of an additional distance and an additional angle from the estimated distance and angle of the fiduciary marker as a failure boundary at which recognition of the fiduciary marker is assumed to fail;

in which the failure boundary comprises a video camera frustrum and a circle having a diameter equal to a maximum distance at which the fiduciary marker can be recognised, the circle intersecting an image plane of the video camera and having an angle with respect to the image plane of the video camera that is the same as that of the fiduciary marker.

6. A method according to claim 5, further comprising calculating whether either of the estimated distance and angle of the fiduciary marker lies within at least one of a threshold distance and threshold angle from the failure boundary.

7. A method according to claim 5, further comprising augmenting the captured image responsive to whether the fiduciary marker is calculated to lie within a warning boundary being at least one of a threshold distance and threshold angle from the failure boundary.

8. A method according to claim 7, further comprising indicating a restorative motion of the marker that would take the fiduciary marker back out of the warning boundary.

9. A non-transitory computer program product comprising computer program instructions that when performed by a processor implement a method comprising the steps of:

receiving a captured image from a video camera;

detecting a fiduciary marker within the captured image;

estimating a distance and angle of the fiduciary marker; and

calculating at least one of an additional distance and an additional angle from the estimated distance and angle of the fiduciary marker as a failure boundary at which recognition of the fiduciary marker is assumed to fail;

in which the failure boundary comprises a video camera frustrum and a circle having a diameter equal to a maximum distance at which the fiduciary marker can be recognised, the circle intersecting an image plane of the video camera and having an angle with respect to the image plane of the video camera that is the same as that of the fiduciary marker.