Interactivity via mobile image recognition

• US 8,817,045 B2
• Filed: 03/22/2011
• Issued: 08/26/2014
• Est. Priority Date: 11/06/2000
• Status: Expired due to Term

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Cohen, Ronald H.
• Primary Examiner(s): WANG, JIN CHENG
• Application Number:
  US13/069,157
• Publication Number:
  US 20110170747A1
• Time in Patent Office: 1,253 Days
• Field of Search: 345/158, 345/169, 345632-634, 382/165, 382/170, 382/100, 382/181, 382/182, 463/37, 463/38, 715/700, 715/863, 709201-203, 705 23- 27, 707 1- 6, 725/37, 725/40, 725/42, 725/47, 725/50, 725/51, 725 59- 61
• US Class Current: 345/633
• CPC Class Codes: G06F 18/21 Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/7515 Shifting the patterns to accommodate for positional errors
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations

Abstract

Systems and methods of interacting with a virtual space, in which a mobile device is used to electronically capture image data of a real-world object, the image data is used to identify information related to the real-world object, and the information is used to interact with software to control at least one of: (a) an aspect of an electronic game; and (b) a second device local to the mobile device. Contemplated systems and methods can be used to gaming, in which the image data can be used to identify a name of the real-world object, to classify the real-world object, identify the real-world object as a player in the game, to identify the real-world object as a goal object or as having some other value in the game, to use the image data to identify the real-world object as a goal object in the game.

Claims

1. An interactive content presentation platform comprising:

a remote server computer communicatively coupled with a mobile device, wherein the mobile device includes an image sensor, the remote server computer configured to;

obtain, from the mobile device, object data captured by the image sensor, wherein the object data includes an object data representation of a printed media advertisement;

recognize at least a portion of the printed media advertisement represented in the object data as an interactive printed media target object based on the object data representation of the printed media advertisement;

identify an information address corresponding to information content based on the interactive printed media target object and based on a current time;

provide access to the information content back to the mobile device by sending the information address to the mobile device where the corresponding information content enables the mobile device to interact with the printed media advertisement, wherein the information content is presented on an electronic display external to the mobile device.

2. The platform of claim 1, wherein the information content comprises a menu.

3. The platform of claim 1, wherein the information content comprises a shopping cart.

4. The platform of claim 1, wherein the information content comprises interactive content.

5. The platform of claim 4, wherein the interactive content comprises at least one of the following:

a program, a game, a radio program, a motion picture, music, and news.

6. The platform of claim 5, wherein the interactive content is modified based on at least one of the following:

user identify, current time, appearance of shadows, temperature, a location of the mobile device, other users, and lights.

7. The platform of claim 5, wherein the modified content comprises created content.

8. The platform of claim 4, wherein the interactive content comprises modified content generated based on determined conditions at a location of the mobile device.

9. The platform of claim 1, wherein the mobile device comprises a mobile telephone.

10. The platform of claim 1, wherein the mobile device comprises a portable computer.

11. The platform of claim 1, wherein the printed media advertisement is at least part of a magazine.

12. The platform of claim 1, wherein the printed media advertisement is at least part of a newspaper.

13. The platform of claim 1, wherein the printed media advertisement is at least part of a billboard.

14. The platform of claim 1, wherein the printed media advertisement comprises digital media displayed on a display screen.

15. The platform of claim 1, wherein the information content comprises a virtual space.

16. The platform of claim 15, wherein the information content comprises a virtual object within the virtual space.

17. The platform of claim 16, wherein the virtual object is superimposed on a real-world scene comprising the printed media advertisement.