Intuitive mobile device interface to virtual spaces

• US 20040012566A1
• Filed: 06/30/2003
• Published: 01/22/2004
• Est. Priority Date: 03/29/2001
• Status: Active Grant

• Current Assignee: Gary R. Bradski
• Original Assignee: Gary R. Bradski
• Inventors: Bradski, Gary R.
• Granted Patent: US 7,271,795 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

The present invention relates to a simple to use intuitive interface for mobile devices and, in particular, to a method and apparatus to permit the motion of a mobile device to serve as an input to the mobile device. In various embodiments, the relative and/or absolute motion, distance and/or acceleration for instance, of the mobile device may be mapped to correspond to particular commands. In one embodiment, this permits the display screen of the mobile device to serve as a virtual window to view a large data set by modifying the view of the displayed data according to the motion of the mobile device. In another embodiment, the present invention allows the user to navigate a virtual space, displayed on the screen of the mobile device, by the motion of the mobile device in real space. Additionally, the user may also control the different displayed views of virtual objects by the relative and/or absolute motion of the mobile device.

Claims

1. A method comprising:

detecting the motion of a mobile device; and

modifying the display of the mobile device based on the detected motion of the mobile device.

2. The method of claim 1 wherein detecting the motion of a mobile device includes detecting the motion in one or more spatial dimensions.

3. The method of claim 1 wherein detecting the motion of a mobile device includes:

detecting the motion of the device in multi-dimensional space; and

measuring the time of the motion.

4. The method of claim 1 wherein the relative motion of the mobile device is detected.

5. The method of claim 1 wherein the absolute motion of the mobile device is detected.

6. The method of claim 1 wherein modifying the display is based on a predetermined relationship between the motion and one or more display altering commands.

7. The method of claim 1 further comprising:

correlating the motion of the mobile device to one or more commands.

8. The method of claim 7 wherein the one or more commands include display altering instructions.

9. The method of claim 1 wherein tilting the mobile device along its long axis causes a displayed document to scroll until the tilt is stopped.

10. The method of claim 1 wherein moving the mobile device along an axis perpendicular to the display screen causes the displayed data to zoom in if the motion is in a first direction and zoom out if the motion is in a second direction.

11. The method of claim 1 wherein moving the mobile device from a first position in space to a second position is space causes the view of a displayed object to change from a first position to a second position.

12. A method comprising:

detecting the gesture-based motion of a mobile device; and

modifying the display of the mobile device based on the detected motion of the mobile device.

13. The method of claim 12 wherein the relative gesture-based motion of the mobile device is detected.

14. The method of claim 12 wherein the absolute gesture-based motion of the mobile device is detected.

15. A device comprising:

a processing unit to receive input signals and generate output signals;

a display screen, coupled to the processing unit, to display information according to signals received from the processing unit; and

a motion detection system communicatively coupled to the processing unit, to detect the motion of the device and provide corresponding signals to the processing unit.

16. The device of claim 15 wherein the processing unit receives input signals from the motion detection system and generates display altering output signals corresponding to the input signals from the motion detection system.

17. The device of claim 15 wherein what is displayed on the display screen changes according to a predetermined relationship between the motion of the device and the corresponding effect on the view of what is displayed on the screen.

18. The device of claim 15 wherein the motion detection system detects the gesture-based motion of the mobile device.

19. The device of claim 15 wherein the motion detection system includes one or more accelerometers configured to detect the motion of the device in one or more spatial dimensions.

20. The device of claim 15 wherein the motion detection system includes one or more ultrasonic sensors configured to detect the motion of the device in one or more spatial dimensions.

21. The device of claim 15 wherein the motion detection system includes one or more magnetic sensors configured to detect the motion of the device in one or more spatial dimensions.

22. The device of claim 15 wherein the motion detection system includes an optical detection apparatus coupled to the device to detect multiple external references from a first position and from a second position to determine the device'"'"'s motion.

23. The device of claim 15 wherein the motion detection system is physically detached from the mobile device.

24. The device of claim 15 wherein the motion detection system includes multiple reference markers on the device and an optical detection apparatus separate from the device to detect the multiple reference markers when the device is at a first position and at a second position thereby determining the device'"'"'s motion.

25. A system comprising:

means for detecting the motion of a mobile device; and

means for modifying what is displayed on the screen of the mobile device based on the detected motion of the mobile device.

26. The system of claim 25 further comprising means for correlating the motion of the mobile device to one or more display altering instructions.

27. The system of claim 25 wherein what is displayed on the display screen changes according to a predetermined relationship between the motion of the mobile device and corresponding effect on the view of what is displayed on the screen.

28. A machine-readable medium comprising at least one instruction to correlate motion in real space to motion in virtual space, which when executed by a processor, causes the processor to perform operations comprising:

detecting the motion of a mobile device; and

correlating the motion of the mobile device to a one or more display altering commands.

29. The machine-readable medium as recited by claim 28 further comprising:

modifying the display of the mobile device based on the one or more display altering commands.

30. The machine-readable medium as recited by claim 28 wherein detecting the motion of a mobile device includes detecting gesture-based motions of the mobile device.