Intuitive mobile device interface to virtual spaces

• US 6,798,429 B2
• Filed: 03/29/2001
• Issued: 09/28/2004
• Est. Priority Date: 03/29/2001
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Bradski, Gary R.
• Primary Examiner(s): Saras, Steven
• Assistant Examiner(s): FATAHI YAR, MAHMOUD
• Application Number:
  US09/820,478
• Publication Number:
  US 20020140666A1
• Time in Patent Office: 1,279 Days
• Field of Search: 345/156, 345/157, 345/158, 345/162, 345/169, 345/173, 345/649, 345/659, 345/672, 345/684, 345/685, 345/688, 345/863, 702/150, 702/151, 702/152, 702/153, 702/154, 368/224, 368/225, 463/30, 463/38
• US Class Current: 345/156
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

The present invention relates to a simple to use intuitive interface for mobile devices and, in particular, to a method and apparatus to permit the motion of a mobile device to serve as an input to the mobile device. In various embodiments, the relative and/or absolute motion, distance and/or acceleration for instance, of the mobile device may be mapped to correspond to particular commands. In one embodiment, this permits the display screen of the mobile device to serve as a virtual window to view a large data set by modifying the view of the displayed data according to the motion of the mobile device. In another embodiment, the present invention allows the user to navigate a virtual space, displayed on the screen of the mobile device, by the motion of the mobile device in real space. Additionally, the user may also control the different displayed views of virtual objects by the relative and/or absolute motion of the mobile device.

Claims

1. A method comprising:

detecting the absolute motion of a mobile device in multi-dimensional space;

measuring the time of the motion; and

modifying a display of the mobile device based on the detected motion of the mobile device.

2. The method of claim 1 wherein detecting the motion of the mobile device includes detecting the motion in one or more spatial dimensions.

3. The method of claim 1 wherein modifying the display is based on a predetermined relationship between the motion and one or more display altering commands.

4. The method of claim 1 further comprising:

correlating the motion of the mobile device to one or more commands.

5. The method of claim 4 wherein the one or more commands include display altering instructions.

6. The method of claim 1 wherein tilting the mobile device along its long axis causes a displayed document to scroll until the tilt is stopped.

7. The method of claim 1 wherein moving the mobile device along an axis perpendicular to the display screen causes the displayed data to zoom in if the motion is in a first direction and zoom out if the motion is in a second direction.

8. The method of claim 1 wherein moving the mobile device from a first position in space to a second position in space causes the view of a displayed object to change from a first position to a second position.

9. The method of claim 1 wherein the absolute gesture-based motion of the mobile device is detected.

10. The method of claim 1 wherein detecting the absolute motion further comprises placing multiple reference markers on the mobile device and optically detecting the multiple reference markers with an apparatus separate from the mobile device when the mobile device is at first position and at a second position thereby determining the mobile device'"'"'s motion.

11. A device comprising:

a processing unit to receive input signals and generate output signals;

a display screen, coupled to the processing unit, to display information according to signals received from the processing unit; and

a motion detection system communicatively coupled to the processing unit, to detect the absolute motion of the device in multi-dimensional space, to measure the time of the motion, and to provide corresponding signals to the processing unit.

12. The device of claim 11 wherein the processing unit receives input signals from the motion detection system and generates display altering output signals corresponding to the input signals from the motion detection system.

13. The device of claim 11 wherein what is displayed on the display screen changes according to a predetermined relationship between the motion of the device and the corresponding effect on the view of what is displayed on the screen.

14. The device of claim 11 wherein the motion detection system detects the gesture-based motion of the mobile device.

15. The device of claim 11 wherein the motion detection system includes one or more accelerometers configured to detect the motion of the device in one or more spatial dimensions.

16. The device of claim 11 wherein the motion detection system includes one or more ultrasonic sensors configured to detect the motion of the device in one or more spatial dimensions.

17. The device of claim 11 wherein the motion detection system includes one or more magnetic sensors configured to detect the motion of the device in one or more spatial dimensions.

18. The device of claim 11 wherein the motion detection system includes an optical detection apparatus coupled to the device to detect multiple external references from a first position and from a second position to determine the device'"'"'s motion.

19. The device of claim 11 wherein the motion detection system is physically detached from a mobile device that includes the display screen.

20. The device of claim 11 wherein the motion detection system includes multiple reference markers on the device and an optical detection apparatus separate from the device to detect the multiple reference markers when the device is at a first position and at a second position thereby determining the device'"'"'s motion.

21. The device of claim 11 wherein a displayed document on the display screen scrolls when the mobile device is tilted along its long axis and continues scrolling until the tilt is stopped.

22. The device of claim 11 wherein displayed data on the display screen zooms in if the motion of the mobile device is in a first direction along an axis perpendicular to the display screen and zooms out if the motion is in a second direction along an axis perpendicular to the display screen.

23. A system comprising:

means for detecting the absolute motion of a mobile device in multi-dimensional space;

means for measuring the time of the motion; and

means for modifying what is displayed on a display screen of the mobile device based on the detected motion of the mobile device.

24. The system of claim 23 further comprising means for correlating the motion of the mobile device to one or more display altering instructions.

25. The system of claim 23 wherein what is displayed on the display screen changes according to a predetermined relationship between the motion of the mobile device and corresponding effect on the view of what is displayed on the screen.

26. The system of claim 23 wherein the means for modifying what is displayed causes a displayed document to scroll when the mobile device is tilted along its long axis until the tilt is stopped.

27. The system of claim 23 wherein the means for modifying what is displayed causes displayed data to zoom in if the motion is in a first direction along an axis perpendicular to the display screen and zoom out if the motion is in a second direction along an axis perpendicular to the display screen.

28. The system of claim 23 wherein the means for detecting the absolute motion further comprises means for optically detecting multiple reference markers on the device when the device is at a first position and at a second position thereby determining the device'"'"'s motion, wherein the means for optically detecting is separate from the device.

29. A machine-readable medium comprising at least one instruction to correlate motion in real space to motion in virtual space, which when executed by a processor, causes the processor to perform operations comprising:

detecting the absolute motion of a mobile device in multi-dimensional space;

measuring the time of the motion; and

correlating the motion of the mobile device to a one or more display altering commands.

30. The machine-readable medium as recited by claim 29 further comprising:

modifying the display of the mobile device based on the one or more display altering commands.

31. The machine-readable medium as recited by claim 29 wherein detecting the motion of a mobile device includes detecting gesture-based motions of the mobile device.

32. The machine-readable medium as recited by claim 29 wherein tilting the mobile device along its long axis causes a displayed document to scroll until the tilt is stopped.

33. The machine-readable medium as recited by claim 29 wherein moving the mobile device along an axis perpendicular to a display screen causes the displayed data to zoom in if the motion is in a first direction and zoom out if the motion is in a second direction.