MOBILE DEVICE FOR AUGMENTED REALITY APPLICATION

• US 20110254860A1
• Filed: 11/24/2009
• Published: 10/20/2011
• Est. Priority Date: 12/03/2008
• Status: Active Grant

• Current Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Original Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Inventors: Zontrop, Pascal, Godon, Marc Bruno Frieda
• Granted Patent: US 8,907,982 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/219 for aiming at specific areas on the display, e.g. light-guns
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/5378 for displaying an additional top view, e.g. radar screens or maps using two or more virtual cameras concurrently A63F13/5252
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/301 using an additional display connected to the game console, e.g. on the controller
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

The mobile device includes a visual input device, for capturing external visual information having real visual background information, and a processing device. The processing device is for associating a selected application with the external visual information, and for executing the selected application based on the external visual information and on user-related input information. The processing device for generating a visual output signal related to at least one virtual visual object in response to the application is further configured to provide the visual output signal to a projector device included within the mobile device such that the projector device will be configured to project said visual output signal related to the at least one virtual visual object onto the visual background, thereby modifying said external visual information.

Claims

1. Mobile device comprising a visual input device for capturing external visual information comprising real visual background information, a processing device configured to associate a selected application with the external visual information, and to execute the selected application based on the external visual information and on user-related input information, and to generate a visual output signal related to at least one virtual visual object in response to said application

wherein

said processing device is further configured to provide said visual output signal to a projector device included within said mobile device such that said projector device will be configured to project said visual output signal related to said at least one virtual visual object onto said visual background, thereby modifying said external visual information.

2. Mobile device according to claim 1 wherein said user-related input information comprises visual information included in said real visual background information.

3. Mobile device according to claim 1 wherein said user-related input information comprises movement information detected by a movement detector incorporated within said mobile device and configured to determine a movement of said mobile device with respect to said visual background.

4. Mobile device according to claim 1 wherein said processing device is further configured to discriminate from said external visual information received from said visual input device, said real visual background information and at least one virtual visual object earlier projected onto said background.

5. Mobile device according to claim 4 wherein said processing device is further configured to analyze said at least one virtual visual object and said real visual background information so as to determine from them metadata information.

6. Mobile device according to claim 5 wherein said processing device is further configured to execute said selected application based upon said metadata information.

7. Mobile device according to claim 1 wherein said processing device is configured to generate a second visual output signal related to said at least one virtual visual object for provision to a display comprised in said mobile device.

8. Mobile device according to claim 7 wherein said processing device is further configured to generate said second visual output signal as comprising said at least one virtual visual object overlaying said background information.

9. Mobile device according to claim 1 wherein said processing device is further configured to generate said second visual output signal as comprising at least one other virtual visual object.

10. Mobile device according to claim 7 wherein said processing device is further configured to generate said second visual output signal as comprising said at least one virtual visual object overlaying said at least one other virtual visual object generated by said application and/or said background information.