Method of executing an application in a mobile device

• US 8,226,011 B2
• Filed: 04/05/2006
• Issued: 07/24/2012
• Est. Priority Date: 04/06/2005
• Status: Expired due to Fees

• Current Assignee: Eidgenoessische Technische Hochschule Zuerich
• Original Assignee: Eidgenoessische Technische Hochshcule Zuerich
• Inventors: Rohs, Michael, Merkli, Jean-Daniel
• Primary Examiner(s): Ahmed, Masud
• Application Number:
  US11/910,921
• Publication Number:
  US 20080194323A1
• Time in Patent Office: 2,302 Days
• Field of Search: 463/25, 463/42
• US Class Current: 235/462.46
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/332 using wireless networks, e.g. cellular phone networks
• CPC Class Codes: A63F 13/35 Details of game servers
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1031 using a wireless connection, e.g. Bluetooth, infrared connections
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/1075 using a touch screen
• CPC Class Codes: A63F 2300/1081 Input via voice recognition
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/205 for detecting the geographical location of the game platform
• CPC Class Codes: A63F 2300/406 Transmission via wireless network, e.g. pager or GSM
• CPC Class Codes: A63F 2300/50 characterized by details of game servers
• CPC Class Codes: A63F 2300/5573 : player location
• CPC Class Codes: A63F 2300/66 : for rendering three dimensional images
• CPC Class Codes: A63F 2300/69 : Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: A63F 2300/695 : Imported photos, e.g. of the player
• CPC Class Codes: A63F 2300/8011 : Ball

Abstract

For executing an application (13) in a mobile device (1) comprising a camera (14), a visual background (2) is captured through the camera (14). A selected application (13) is associated with the visual background (2). The selected application (13) is executed in the mobile device (1). Determined are orientation parameters indicative of an orientation of the mobile device (1) relative to the visual background (2). Based on the orientation parameters, application-specific output signals are generated in the mobile device (1). Particularly, the captured visual background (2) is displayed on the mobile device (1) overlaid with visual objects based on the orientation parameters. Displaying the captured visual background with overlaid visual objects, selected and/or positioned dependent on the relative orientation of the mobile device (1), makes possible interactive augmented reality applications, e.g. interactive augmented reality games, controlled by the orientation of the mobile device (1) relative to the visual background (2).

Claims

1. A method of executing an application in a mobile device including a camera, the method comprising:

capturing through the camera a visual background external to the mobile device;

generating background image data representative of the visual background;

detecting from the background image data at least one barcode;

selecting an application based on information encoded in the at least one barcode;

associating the selected application with the visual background;

executing the selected application in the mobile device;

determining orientation parameters indicative of an orientation of the mobile device relative to the visual background using the at least one barcode; and

generating application-specific output signals in the mobile device based at least on the orientation parameters, wherein the output signals include tactile signals and the selected application includes descriptive language statements;

wherein executing the selected application includes interpreting the descriptive language statements by an execution engine in the mobile device; and

wherein generating the output signals includes generating the output signals by the execution engine as determined by the descriptive language statements of the selected application.

2. The method of claim 1, wherein generating the output signals includes displaying on the mobile device the visual background overlaid with visual objects based on the orientation parameters.

3. The method of claim 1, wherein generating the output signals includes animating the visual objects overlaid on the visual background based on the orientation parameters.

4. The method of claim 1, wherein determining the orientation parameters includes determining changes in the orientation of the mobile device relative to the visual background;

and wherein generating output signals is based on orientation parameters indicative of said changes in the orientation of the mobile device.

5. The method of claim 1, wherein the at least one barcode includes at least one two-dimensional barcode having a built-in orientation-independent coordinate system.

6. The method of claim 1, further comprising loading the selected application via a communication link into the mobile device.

7. The method of claim 1, wherein the application is a game;

wherein the output signals are game related output signals; and

wherein the selected application defines states of the game based at least on the orientation parameters.

8. The method of claim 7, wherein the application is a multi-user game;

and wherein the selected application communicates said states via a communication link to at least one other mobile device.

9. The method of claim 1, further comprising triggering execution of functions of the selected application based on the orientation parameters.