Intuitive mobile device interface to virtual spaces

• US 20040196259A1
• Filed: 06/30/2003
• Published: 10/07/2004
• Est. Priority Date: 03/29/2001
• Status: Abandoned Application

• Current Assignee: Gary R. Bradski
• Original Assignee: Gary R. Bradski
• Inventors: Bradski, Gary R.
• Application Number:
  US10/611,178
• Publication Number:
  US 20040196259A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

The present invention relates to a simple to use intuitive interface for mobile devices and, in particular, to a method and apparatus to permit the motion of a mobile device to serve as an input to the mobile device. In various embodiments, the relative and/or absolute motion, distance and/or acceleration for instance, of the mobile device may be mapped to correspond to particular commands. In one embodiment, this permits the display screen of the mobile device to serve as a virtual window to view a large data set by modifying the view of the displayed data according to the motion of the mobile device. In another embodiment, the present invention allows the user to navigate a virtual space, displayed on the screen of the mobile device, by the motion of the mobile device in real space. Additionally, the user may also control the different displayed views of virtual objects by the relative and/or absolute motion of the mobile device.

Claims

1. A method comprising:

providing multiple reference markers on a mobile device;

detecting the absolute motion of the mobile device with an optical detection apparatus separate from the mobile device to detect the multiple reference markers when the mobile device is at a first position and at a second position thereby determining the mobile device'"'"'s motion; and

modifying a display of the mobile device based on the detected motion of the mobile device.

2. The method of claim 1 wherein detecting the motion of the mobile device includes detecting the motion in one or more spatial dimensions.

3. The method of claim 1 wherein detecting the motion of the mobile device includes:

detecting the motion of the mobile device in multi-dimensional space; and

measuring the time of the motion.

6. The method of claim 1 wherein modifying the display is based on a predetermined relationship between the motion and one or more display altering commands.

7. The method of claim 1 further comprising:

correlating the motion of the mobile device to one or more commands.

8. The method of claim 7 wherein the one or more commands include display altering instructions.

9. The method of claim 1 wherein tilting the mobile device along its long axis causes a displayed document to scroll until the tilt is stopped.

10. The method of claim 1 wherein moving the mobile device along an axis perpendicular to a display screen causes displayed data to zoom in if the motion is in a first direction and zoom out if the motion is in a second direction.

11. The method of claim 1 wherein moving the mobile device from a first position in space to a second position in space causes the view of a displayed object to change from a first position to a second position.

14. The method of claim 1 wherein the absolute gesture-based motion of the mobile device is detected.

33. The method of claim 1 wherein detecting the motion of a mobile device includes:

detecting the motion of the mobile device in multi-dimensional space; and

measuring the time of the motion.

4. (Cancelled)

5. (Cancelled)

12. (Cancelled)

13. (Cancelled)

15. A device comprising:

a processing unit to receive input signals and generate output signals;

a display screen, coupled to the processing unit, to display information according to signals received from the processing unit;

multiple reference markers connected to the display screen; and

an optical motion detection system separate from the display screen and communicatively coupled to the processing unit, the detection system to detect the multiple reference markers when the device is at a first position and at a second position thereby determining the absolute motion of the device and providing corresponding signals to the processing unit.

16. The device of claim 15 wherein the processing unit receives input signals from the motion detection system and generates display altering output signals corresponding to the input signals from the motion detection system.

17. The device of claim 15 wherein what is displayed on the display screen changes according to a predetermined relationship between the motion of the device and the corresponding effect on the view of what is displayed on the screen.

18. The device of claim 15 wherein the motion detection system detects the gesture-based motion of the mobile device.

19. The device of claim 15 wherein the motion detection system includes one or more accelerometers configured to detect the motion of the device in one or more spatial dimensions.

20. The device of claim 15 wherein the motion detection system includes one or more ultrasonic sensors configured to detect the motion of the device in one or more spatial dimensions.

21. The device of claim 15 wherein the motion detection system includes one or more magnetic sensors configured to detect the motion of the device in one or more spatial dimensions.

34. The device of claim 15 wherein a displayed document on the display screen scrolls when the mobile device is tilted along its long axis and continues scrolling until the tilt is stopped.

35. The device of claim 15 wherein displayed data on the display screen zooms in if the motion of the mobile device is in a first direction along an axis perpendicular to the display screen and zooms out if the motion is in a second direction along an axis perpendicular to the display screen.

22-24. -24. (Cancelled)

25. A system comprising:

optical means for detecting the absolute motion of a mobile device that includes multiple reference markers on the mobile device, the optical means being separate from the mobile device; and

means for modifying what is displayed on a display screen of the mobile device based on the detected motion of the mobile device.

26. The system of claim 25 further comprising means for correlating the motion of the mobile device to one or more display altering instructions.

27. The system of claim 25 wherein what is displayed on the display screen changes according to a predetermined relationship between the motion of the mobile device and corresponding effect on the view of what is displayed on the display screen.

36. The system of claim 25 wherein the means for modifying what is displayed causes a displayed document to scroll when the mobile device is tilted along its long axis until the tilt is stopped.

37. The system of claim 25 wherein the means for modifying what is displayed causes displayed data to zoom in if the motion is in a first direction along an axis perpendicular to the display screen and zoom out if the motion is in a second direction along an axis perpendicular to the display screen.

38. The system of claim 25 wherein the means for detecting the absolute motion further comprises means for detecting the motion of the device in multi-dimensional space, and means for measuring the time of the motion.

28. A machine-readable medium comprising at least one instruction to correlate motion in real space to motion in virtual space, which when executed by a processor, causes the processor to perform operations comprising:

detecting the absolute motion of a mobile device; and

correlating the motion of the mobile device to a one or more display altering commands.

29. The machine-readable medium as recited by claim 28 further comprising:

modifying the display of the mobile device based on the one or more display altering commands.

30. The machine-readable medium as recited by claim 28 wherein detecting the motion of a mobile device includes detecting gesture-based motions of the mobile device.

31. The machine-readable medium as recited by claim 28 wherein tilting the mobile device along its long axis causes a displayed document to scroll until the tilt is stopped.

32. The machine-readable medium as recited by claim 28 wherein moving the mobile device along an axis perpendicular to a display screen causes the displayed data to zoom in if the motion is in a first direction and zoom out if the motion is in a second direction.