IMAGE COMBINING METHOD, SYSTEM AND APPARATUS

• US 20100048290A1
• Filed: 08/19/2008
• Published: 02/25/2010
• Est. Priority Date: 08/19/2008
• Status: Abandoned Application

• Current Assignee: Sony Interactive Entertainment Europe Limited (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Europe Limited (Sony Group Corp.)
• Inventors: Doucet, Nicolas, Baseley, Nathan James
• Application Number:
  US12/193,868
• Publication Number:
  US 20100048290A1
• Time in Patent Office: Days
• US Class Current: 463/25
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: A63F 2300/8094 Unusual game types, e.g. virtual cooking

Abstract

A method of rewarding an end-user of a product. The method comprises supplying, in association with the product, an augmented reality marker for use with an augmented reality application. The augmented reality marker is provided as a free promotional supplement to the product.

Claims

1. A method of rewarding an end-user of a product, wherein said method comprises supplying, in association with said product, an augmented reality marker for use with an augmented reality application, and said augmented reality marker is provided as a free promotional supplement to said product.

2. The method of claim 1, wherein said product and said augmented reality marker are supplied to said end-user following purchase of said product by said end-user.

3. The method of claim 1, wherein said product is supplied within a product package and said augmented reality marker is printed on said product package.

4. The method of claim 1, wherein said product is supplied within a product package and said augmented reality marker is supplied within said product package.

5. The method of claim 1, wherein said augmented reality marker is printed on said product.

6. The method of claim 1, wherein said product is supplied within a product package and said augmented reality marker is removably attached to said product package.

7. The method of claim 1, wherein said augmented reality application is associated with a client device associated with said end-user, said client device having an image receiver and a data receiver, and said product and augmented reality marker being supplied from a supply source, said method comprising:

storing, at a data source, augmented reality marker data associated with said augmented reality marker;

capturing, using a video camera, a sequence of video images of said augmented reality marker;

receiving, using said image receiver, said sequence of video images via an image communication link;

receiving, using said data receiver, said augmented reality marker data from said data source;

detecting, at said client device, an image feature corresponding to said augmented reality marker within said sequence of video images, said augmented reality marker being detected in dependence upon said augmented reality marker data received from said data source; and

generating, at said client device, a virtual reality image in dependence upon said augmented reality marker data received from said data source; and

combining, at said client device, said virtual reality image with said sequence of video images at an image position substantially corresponding to said image feature so as to generate augmented reality images.

8. The method of claim 7, wherein said augmented reality marker is a three dimensional augmented reality marker.

9. The method of claim 8, wherein:

said augmented reality marker comprises at least two facets having respective distinct image features;

said augmented reality marker data relates to un-distorted versions of said respective distinctive image features; and

said method comprises;

detecting, by analysis of said sequence of video images, a three dimensional orientation of said augmented reality marker with respect to said video camera in dependence upon a relative distortion of image features within said sequence of video images corresponding to said respective facets of said augmented reality marker with respect to said un-distorted versions of said respective distinct image features.

10. The method of claim 8, wherein said three dimensional augmented reality marker comprises three facets arranged adjacently so as to form a corner of a cuboid.

11. The method of claim 10, wherein said three dimensional augmented reality marker comprises a handle by which the marker may be held by said end-user.

12. The method of claim 8, wherein:

said augmented reality marker comprises at least two marker elements having respective distinct image features;

said marker elements can be arranged in a first position for supply to said end-user, said first position being such that said marker elements are arranged to be substantially co-planar with each other; and

said marker elements can be arranged in a second position for detection, said second position being such that said marker elements are arranged not to be substantially co-planar with each other.

13. The method of claim 7, wherein said product comprises said data source, and said data source is a storage medium.

14. The method of claim 13, wherein said augmented reality marker is printed on said storage medium.

15. The method of claim 7, wherein:

said data source comprises a server; and

said method comprises transmitting said augmented reality marker data to said data receiver via a communications network.

16. The method of claim 15, comprising transmitting said augmented reality marker data to said data receiver via said communications network in response to a request from the client device that said augmented reality marker data should be sent from said data source to said client device.

17. The method of claim 15, comprising transmitting said augmented reality marker data to said data receiver via said communications network in response to an indication by said supply source that said augmented reality marker is to be supplied to said end-user.

18. The method of claim 7, wherein said augmented reality marker data comprises game data which relates to a game characteristic associated with said virtual reality image.

19. The method of claim 7, wherein:

said augmented reality marker data comprises rendering data; and

said method comprises generating said virtual reality image for display in dependence upon said rendering data.

20. An image combining method for combining virtual images with real images captured by a video camera so as to generate augmented reality images at a client device associated with an end-user, said client device having an image receiver and a data receiver, said method comprising:

storing, at a data source, augmented reality marker data;

supplying, in association with a product, an augmented reality marker to said user, said augmented reality marker being provided as a free promotional supplement to said product, and said augmented reality marker being associated with said augmented reality marker data;

capturing a sequence of video images of said augmented reality marker;

receiving, using said image receiver, said sequence of video images via an image communication link;

receiving, using said data receiver, said augmented reality marker data from said data source;

detecting, at said client device, an image feature corresponding to said augmented reality marker within said sequence of video images, said augmented reality marker being detected in dependence upon said augmented reality marker data received from said data source; and

generating, at said client device, a virtual reality image in dependence upon said augmented reality marker data received from said data source; and

combining, at said client device, said virtual reality image with said sequence of video images at an image position substantially corresponding to said image feature so as to generate augmented reality images.

21. An image combining system arranged to combine virtual images with real images captured by a video camera so as to generate augmented reality images, said system comprising:

a data source arranged to store augmented reality marker data;

a supply source arranged to supply, in association with a product, an augmented reality marker to an end-user, said augmented reality marker being provided as a free promotional supplement to said product, and said augmented reality marker being associated with said augmented reality marker data;

a video camera operable to capture video images of the augmented reality marker; and

a client device associated with said end-user, said client device comprising;

an image receiver operable to receive a sequence of video images from said video camera via an image communication link;

a data receiver operable to receive said augmented reality marker data from said data source;

a detector operable to detect, within said sequence of video images, an image feature corresponding to said augmented reality marker which was supplied from said supply source, said image feature being detected in dependence upon said augmented reality marker data received from said data source; and

a processor operable to;

generate a virtual reality image in dependence upon said augmented reality marker data received from said data source; and

combine said virtual reality image with said sequence of video images at an image position substantially corresponding to said image feature so as to generate augmented reality images.

22. An image combining device for combining virtual images with real images captured by a video camera so as to generate augmented reality images, said device being associated with an end-user, and said device comprising:

an image receiver operable to receive a sequence of video images from said video camera via an image communication link;

a data receiver operable to receive augmented reality marker data from a data source, said augmented reality marker data being associated with an augmented reality marker;

a detector operable to detect, within said sequence of video images, an image feature corresponding to said augmented reality marker, said augmented reality marker being supplied to said end-user in association with a product, said augmented reality marker being provided as a free promotional supplement to said product, and said image feature being detected in dependence upon said augmented reality marker data received from said data source; and

a processor operable to;

generate a virtual reality image in dependence upon said augmented reality marker data received from said data source; and

combine said virtual reality image with said sequence of video images at an image position substantially corresponding to said image feature so as to generate augmented reality images.

23. An augmented reality marker for use with an augmented reality generation system, said augmented reality marker comprising:

a primary facet comprising an image for recognition by said augmented reality generation system; and

one or more secondary facets arranged with respect to said primary facet such that said primary facet is not parallel to said one or more secondary facets.

24. The augmented reality marker of claim 23, wherein said one or more secondary facets together with said primary facet form faces of a truncated pyramid, and said primary facet surmounts said truncated pyramid.

25. The augmented reality marker of claim 23, wherein said one or more secondary facets are a different colour from said primary facet.