Handheld device with preferred motion selection

• US 7,180,502 B2
• Filed: 03/23/2004
• Issued: 02/20/2007
• Est. Priority Date: 03/23/2004
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Adler, B. Thomas, Marvit, David L., Reinhardt, Albert H. M., Wilcox, Bruce A.
• Primary Examiner(s): LIANG, REGINA
• Application Number:
  US10/807,570
• Publication Number:
  US 20050212758A1
• Time in Patent Office: 1,064 Days
• Field of Search: 345156-158, 715856-864, 348/734
• US Class Current: 345/156
• CPC Class Codes: G06F 1/1613 for portable computers cooling arrangements therefor G06F1/203; constructional details or arrangements for pocket calculators, electronic agendas or books G06F15/0216; constructional details of portable telephone sets: with several bodies H04M1/0202
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A motion controlled handheld device includes a display having a viewable surface and operable to generate an image and a motion detection module operable to detect motion of the device within three dimensions and to identify components of the motion in relation to the viewable surface. The components comprise a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface. The device includes a motion processing module operable to compare the components, to isolate a preferred one of the components based on the comparison, and to adjust a magnitude of the preferred component by an augmentation factor. The device also includes a motion response module operable to modify the image based on the augmented preferred component.

Claims

1. A motion controlled handheld device comprising:

a display having a viewable surface and operable to generate an image;

a motion detection module operable to detect motion of the device within three dimensions and to identify components of the motion in relation to the viewable surface, the components comprising a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface;

a motion processing module operable to compare the components, to isolate a preferred one of the components based on the comparison, and to adjust a magnitude of the preferred component by an augmentation factor; and

a motion response module operable to modify the image based on the augmented preferred component.

2. The motion controlled handheld device of claim 1, wherein:

the image displays a subsection of a larger image; and

the motion response module is further operable to continuously modify the image to display another subsection of the larger image based the augmented preferred component.

3. The motion controlled handheld device of claim 1, wherein:

comparing the components comprises comparing magnitudes of the components; and

isolating the preferred one of the components based on the comparison comprises selecting the one of the components having a magnitude at least twice that of either of the other ones of the components.

4. The motion controlled handheld device of claim 1, wherein a size of the augmentation factor is based on a current state of the device, the current state of the device including a type of application running on the device and a status of the application.

5. The motion controlled handheld device of claim 1, wherein a size of the augmentation factor is based on a speed of the motion of the device.

6. The motion controlled handheld device of claim 1, wherein:

the image displays a subsection of a larger image; and

a size of the augmentation factor is based on a relative size of the image as compared with the larger image.

7. The motion controlled handheld device of claim 1, wherein the motion processing module is further operable to reduce magnitudes of ones of the components other than the preferred component.

8. The motion controlled handheld device of claim 1, further comprising:

a first accelerometer operable to detect acceleration along a first axis;

a second accelerometer operable to detect acceleration along a second axis, the second axis perpendicular to the first axis; and

a third accelerometer operable to detect acceleration along a third axis, the third axis perpendicular to the first axis and perpendicular to the second axis; and

wherein

the motion detection module is further operable to detect motion of the device using the first accelerometer, the second accelerometer, and the third accelerometer, the motion detection module further operable to distinguish between tilt of the device and translation of the device.

9. A method for controlling a handheld device comprising:

detecting motion of the device within three dimensions;

identifying components of the motion in relation to a viewable surface of the device, the components comprising a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface;

comparing the components;

isolating a preferred one of the components based on the comparison;

adjusting a magnitude of the preferred component by an augmentation factor; and

modifying an image displayed on the viewable surface based on the augmented preferred component.

10. The method of claim 9, wherein the image displays a subsection of a larger image, the method further comprising continuously modifying the image to display another subsection of the larger image based the augmented preferred component.

11. The method of claim 9, wherein a size of the augmentation factor is based on a current state of the device, the current state of the device including a type of application running on the device and a status of the application.

12. The method of claim 9, wherein a size of the augmentation factor is based on a speed of the motion of the device.

13. The method of claim 9, wherein:

the image displays a subsection of a larger image; and

a size of the augmentation factor is based on a relative size of the image as compared with the larger image.

14. The method of claim 9, further comprising reducing magnitudes of ones of the components other than the preferred component.

15. A computer program for controlling a handheld device, the computer program embodied in a computer readable medium and operable when executed to perform the steps of:

detecting motion of the device within three dimensions;

identifying components of the motion in relation to a viewable surface of the device, the components comprising a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface;

comparing the components;

isolating a preferred one of the components based on the comparison;

adjusting a magnitude of the preferred component by an augmentation factor; and

modifying an image displayed on the viewable surface based on the augmented preferred component.

16. The computer program of claim 15, wherein the image displays a subsection of a larger image, the method further comprising continuously modifying the image to display another subsection of the larger image based the augmented preferred component.

17. The computer program of claim 15, wherein a size of the augmentation factor is based on a current state of the device, the current state of the device including a type of application running on the device and a status of the application.

18. The computer program of claim 15, wherein a size of the augmentation factor is based on a speed of the motion of the device.

19. The computer program of claim 15, wherein:

the image displays a subsection of a larger image; and

a size of the augmentation factor is based on a relative size of the image as compared with the larger image.

20. The computer program of claim 15, further comprising reducing magnitudes of ones of the components other than the preferred component.

21. A motion controlled handheld device comprising:

means for detecting motion of the device within three dimensions;

means for identifying components of the motion in relation to a viewable surface of the device, the components comprising a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface;

means for comparing the components;

means for isolating a preferred one of the components based on the comparison;

means for adjusting a magnitude of the preferred component by an augmentation factor; and

means for modifying an image displayed on the viewable surface based on the augmented preferred component.