Mobile device for augmented reality applications

• US 8,907,982 B2
• Filed: 11/24/2009
• Issued: 12/09/2014
• Est. Priority Date: 12/03/2008
• Status: Active Grant

• Current Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Original Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Inventors: Zontrop, Pascal, Godon, Marc Bruno Frieda
• Primary Examiner(s): HARRISON, CHANTE E
• Application Number:
  US13/129,488
• Publication Number:
  US 20110254860A1
• Time in Patent Office: 1,841 Days
• Field of Search: 345/619, 345/632, 345/633, 345/158, 345/169, 345/8, 345/419, 715/740, 715/864, 715/810, 709/204, 382/103, 463/39
• US Class Current: 345/633
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/219 for aiming at specific areas on the display, e.g. light-guns
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/5378 for displaying an additional top view, e.g. radar screens or maps using two or more virtual cameras concurrently A63F13/5252
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/301 using an additional display connected to the game console, e.g. on the controller
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

The mobile device includes a visual input device, for capturing external visual information having real visual background information, and a processing device. The processing device is for associating a selected application with the external visual information, and for executing the selected application based on the external visual information and on user-related input information. The processing device for generating a visual output signal related to at least one virtual visual object in response to the application is further configured to provide the visual output signal to a projector device included within the mobile device such that the projector device will be configured to project said visual output signal related to the at least one virtual visual object onto the visual background, thereby modifying said external visual information.

Claims

1. A mobile device comprising:

a visual input device configured to capture external visual information comprising information associated with a real visual background; and

a processing device configured to,

associate a selected application with the external visual information, execute the selected application based on the external visual information and on user-related input information,

generate a visual output signal related to at least one virtual visual object in response to said application,

provide said visual output signal to a projector device included within said mobile device such that said projector device is configured to project said visual output signal related to said at least one virtual visual object onto said real visual background, thereby modifying said external visual information,

distinguish from said external visual information received from said visual input device, said information associated with said real visual background and at least one virtual visual object earlier projected onto said background, and

generate a next visual output signal for the at least one virtual visual object based on the distinguished real visual background information and the at least one virtual visual object earlier projected onto said background.

2. The mobile device according to claim 1, wherein said user-related input information comprises visual information included in said real visual background information.

3. The mobile device according to claim 1, wherein said user-related input information comprises movement information detected by a movement detector incorporated within said mobile device and configured to determine a movement of said mobile device with respect to said real visual background.

4. The mobile device according to claim 1, wherein said processing device is further configured to analyze said at least one virtual visual object and said real visual background information so as to determine from said at least one virtual visual object and said real visual background information, metadata information.

5. The mobile device according to claim 4, wherein said processing device is further configured to execute said selected application based upon said metadata information.

6. The mobile device according to claim 1, wherein said processing device is further configured to generate a second visual output signal related to said at least one virtual visual object for provision to a display comprised in said mobile device.

7. The mobile device according to claim 6, wherein said processing device is further configured to generate said second visual output signal as comprising said at least one virtual visual object overlaying said real visual background information.

8. The mobile device according to claim 1, wherein said processing device is further configured to generate said second visual output signal as comprising at least one other virtual visual object.

9. The mobile device according to claim 6, wherein said processing device is further configured to generate said second visual output signal as comprising said at least one virtual visual object overlaying said at least one other virtual visual object generated by at least one of said application and said real visual background information.