METHOD AND SYSTEM FOR AUGMENTED REALITY

• US 20130300767A1
• Filed: 05/07/2013
• Published: 11/14/2013
• Est. Priority Date: 05/11/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Europe Limited (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Europe Limited (Sony Group Corp.)
• Inventors: Kochi, Masami, Campbell, Diarmid Archibald, Hocking, Ian Michael, Harding, Russell, Ranyard, David
• Granted Patent: US 9,305,400 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

A method of augmented reality includes associating tint information with a predetermined graphical object, and receiving a video image of a real scene comprising a feature for detection. The method further includes detecting the feature in the video image of the real scene and selecting a graphical object responsive to the detected feature, and augmenting the video image with the selected graphical object. If the selected graphical object is the predetermined graphical object, the method further includes retrieving the tint information associated with the predetermined graphical object, and modifying the colour balance of the video image responsive to the tint information.

Claims

1. A method of augmented reality, comprising the steps of:

associating tint information with a predetermined graphical object;

receiving a video image of a real scene comprising a feature for detection;

detecting the feature in the video image of the real scene and selecting a graphical object responsive to the detected feature; and

augmenting the video image with the selected graphical object;

and in which

when the selected graphical object is the predetermined graphical object;

retrieving the tint information associated with the predetermined graphical object; and

modifying a colour balance of the video image responsive to the tint information.

2. The method of claim 1 in which the colour balance is modified uniformly over the whole video image.

3. The method of claim 1 in which the colour balance is modified to an extent dependent on position of a video image pixel with respect to a position of the predetermined graphical object that it will occupy in the augmented video image.

4. The method of claim 3 in which the colour balance is modified to an extent proportional to the distance of a video image pixel from a position of the predetermined graphical object that it will occupy in the augmented video image.

5. A method according to claim 3, in which position offset information is associated with the tint information, and the position of the predetermined graphical object is derived with reference to the position offset information.

6. A method according to claim 1, in which the colour balance is modified in a time variant manner.

7. A method according to claim 1, comprising the steps of:

associating brightness information with the predetermined graphical object; and

when the selected graphical object is the predetermined graphical object, modifying the brightness of the video image responsive to the brightness information.

8. A method according to claim 1, in which the feature for detection is a fiduciary marker.

9. The method of claim 8, in which the fiduciary marker is one of a plurality of respective fiduciary markers printed in a book.

10. A non-transitory computer program product comprising computer program instructions that when performed by a processor implement a method comprising the steps of:

receiving a video image of a real scene comprising a feature for detection;

detecting the feature in the video image of the real scene and selecting a graphical object responsive to the detected feature; and

augmenting the video image with the selected graphical object;

and in which

when the selected graphical object is the predetermined graphical object;

retrieving tint information associated with the predetermined graphical object; and

modifying a colour balance of the video image responsive to the tint information.

14. A system for generating an augmented reality image for display, comprising

the entertainment device of claim 10;

and

a video camera operably coupled to the entertainment device.

15. The system of claim 14, comprising:

a book comprising one or more turnable leaves, upon whose pages are printed respective fiduciary markers.

11. An entertainment device for generating an augmented reality image for display, comprising:

a processor means for associating tint information with a predetermined graphical object;

an input means for receiving a video image of a real scene comprising a feature for detection;

the processor means being configured to detect the feature in the video image of the real scene, and to select a graphical object responsive to the detected feature;

and graphics processing means for augmenting the video image with the selected graphical object;

and in which

when the selected graphical object is the predetermined graphical object,

the processor means is configured to retrieve the tint information associated with the predetermined graphical object; and

the graphics processing means is operable to modify a colour balance of the video image responsive to the tint information.

12. The entertainment device of claim 11, in which the graphics processing means is configured to modify the colour balance to an extent dependent on the position of a video image pixel with respect to the position that the predetermined graphical object will occupy in the augmented video image.

13. The entertainment device of claim 11, in which:

the processor means is configured to associate brightness information with the predetermined graphical object; and

when the selected graphical object is the predetermined graphical object,

the graphics processing means is configured to modify the brightness of the video image responsive to the brightness information.