Camera based orientation for mobile devices

• US 20060287083A1
• Filed: 05/23/2005
• Published: 12/21/2006
• Est. Priority Date: 05/23/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ofek, Eyal, Hsu, Feng-Hsiung
• Granted Patent: US 7,946,921 B2
• Time in Patent Office: Days
• US Class Current: 463/37
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/206 Game information storage, e.g. cartridges, CD ROM's, DVD's, smart cards
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6081 generating an output signal, e.g. under timing constraints, for spatialization

Abstract

In an exemplary embodiment, an on-board camera is used as a controller for a hand-held game device. Control information is provided to a game application via video captured by the camera. As the hand-held device is moved, features of the captured video are tracked. The relative motion between the tracked features and the hand-held device is translated into control information for the game application. Aspects of the game application are rendered on a display of the hand-held game device in accordance with the control information. For example, from a third person perspective, viewing a game character from overhead, rotation of the hand-held game device can be translated into rotation of the character. From a first person perspective, seeing the game through the eyes of the game character, rotation of the hand-held game device can be translated into observing various challenges coming from different directions.

Claims

1. A method for providing control information to an application, said method comprising:

providing a mobile device comprising an optical sensor;

sensing at least one feature via said optical sensor;

providing control information to said application responsive to a relative motion of said at least one sensed feature.

2. A method in accordance with claim 1, further comprising at least one of:

rendering a display on said mobile device in accordance with said control information; and

providing an audible indication in accordance with said control information.

3. A method in accordance with claim 1, where said relative motion is with respect to said mobile device and said at least one sensed feature.

4. A method in accordance with claim 1, wherein:

said mobile device comprises a display device; and

said optical sensor comprises a camera.

5. A method in accordance claim 1, wherein said mobile device comprises one of a hand-held game console, a mobile telephone, a personal data assistant (PDA), a laptop processor, and a tablet personal computer.

6. A method in accordance with claim 1, wherein said control information is formatted in accordance with a predetermined control information format.

7. A method in accordance with claim 6, wherein said predetermined control information comprises at least one of joystick control information, mouse control information, thumbwheel control information, and keyboard control information.

8. A method in accordance with claim 1, wherein:

said mobile device comprises a hand-held game console;

said application comprises a game application;

said relative motion is indicative of a user movement of said hand-held game console;

said relative motion of said at least one feature is translated to control information for controlling an aspect of said game application; and

said aspect of said game application is rendered on a display of said mobile device.

9. A method in accordance with claim 1, wherein said application comprises one of a game application, a spreadsheet application, a menu driven application, and a photo album application.

10. A method in accordance with claim 1, further comprising tracking said at least one feature.

11. A system for providing control information to an application, said system comprising:

a display portion for rendering aspects of said application;

an optical sensor coupled to a processor for;

optically sensing at least one feature; and

providing a signal indicative of said at least one optically sensed feature to said processor; and

said processor coupled to said optical sensor and said display, for;

receiving said signal from said optical sensor;

processing said signal from said optical sensor for determining application control information in accordance relative motion of said at least one optically sensed feature; and

providing a signal indicative of said application control information to said display for rendering aspects of said application.

12. A system in accordance with claim 11, wherein said relative motion is with respect to said optical sensor and said at least one optically sensed feature.

13. A system in accordance with claim 11, wherein said system comprises one of a mobile device, a hand-held game console, a mobile telephone, a personal data assistant (PDA), a laptop processor, and a tablet personal computer.

14. A system in accordance with claim 11, wherein said control information is formatted in accordance with a predetermined control information format.

15. A system in accordance with claim 11, wherein:

said system comprises a hand-held game console;

said optical sensor comprises a camera;

said application comprises a game application;

said relative motion is indicative of a user movement of said hand-held game console;

said relative motion of said at least one feature is translated to control information for controlling an aspect of said game application; and

said aspect of said game application is at least one of;

rendered on a display of said hand-held game console; and

provided audibly from said hand-held game console.

16. A system in accordance with claim 11, wherein said processor tracks said at least one optically sensed feature.

17. A computer readable medium encoded with a computer program code for providing control information to an application, said program code comprising:

a sense code segment for sensing at least one feature via an optical sensor;

a control code segment for providing control information to said application responsive to a relative motion of said at least one sensed feature; and

a render code segment for at least one of;

rendering a display on a mobile device in accordance with said control information; and

providing an audible indication in accordance with said control information.

18. A computer readable medium in accordance with claim 17, wherein said relative motion is with respect to said mobile device and said at least one sensed feature.

19. A computer readable medium in accordance with claim 17, wherein:

said mobile device comprises a hand-held game console;

said application comprises a game application;

said relative motion is indicative of a user movement of said hand-held game console;

said relative motion of said at least one feature is translated to control information for controlling an aspect of said game application; and

said aspect of said game application is rendered on a display of said hand-held game console.

20. A computer readable medium in accordance with claim 17, wherein said control information if formatted in accordance with a predetermined control information format.