Translation controlled cursor

• US 7,365,735 B2
• Filed: 03/23/2004
• Issued: 04/29/2008
• Est. Priority Date: 03/23/2004
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Marvit, David L., Reinhardt, Albert H. M.
• Primary Examiner(s): Liang; Regina
• Application Number:
  US10/807,557
• Publication Number:
  US 20050212766A1
• Time in Patent Office: 1,498 Days
• Field of Search: 345156-158, 345/169, 345/173, 715/856, 715/857, 715/863, 715/864
• US Class Current: 345/156
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 2250/52 including functional features of a camera

Abstract

A motion controlled handheld device includes a display having a viewable surface and operable to generate a current image. The device includes a motion detection module operable to detect motion of the device within three dimensions and to identify components of the motion in relation to the viewable surface. The components comprise a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface. The device also includes a display control module operable to display a cursor on the viewable surface, to determine a translation vector that is substantially opposite to the sum of the first component and the second component, and to translate the cursor across the viewable surface according to the translation vector in order to substantially maintain the position of the cursor in space with respect to the viewable surface.

Claims

1. A motion controlled handheld device comprising:

a display having a viewable surface and operable to generate a current image;

a motion detection module operable to detect motion of the device within three dimensions and to identify components of the motion in relation to the viewable surface, the components comprising a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface;

a display control module operable to display a cursor on the viewable surface, to determine a translation vector that is substantially opposite to the sum of the first component and the second component, and to translate the cursor across the viewable surface according to the translation vector in order to substantially maintain the position of the cursor in space with respect to the viewable surface;

a gesture database comprising a plurality of gestures, each gesture defined by a motion of the device with respect to a first position of the device;

a gesture mapping database mapping each of the gestures to a corresponding command;

a motion response module operable to identify a matching one of the gestures based on the motion and to determine a corresponding one of the commands based on the identified gesture; and

wherein the display control module is further operable to logically parse a viewable image into a plurality of grid sections, to set one of the grid sections as the current image, and to set another one of the grid sections as the current image in response to the determined command.

2. The motion controlled handheld device of claim 1, wherein the display control module is further operable to maintain the current image while the cursor translates across the viewable surface.

3. The motion controlled handheld device of claim 1, wherein the display control module is further operable to freeze translation of the cursor across the viewable surface in response to a command.

4. The motion controlled handheld device of claim 1, wherein the display control module is further operable to determine that the translation vector indicates translation of the cursor past an edge of the viewable surface and, in response, to reduce a magnitude of the translation vector to maintain the cursor within the viewable surface.

5. The motion controlled handheld device of claim 4, wherein reducing the magnitude of the translation vector to maintain the cursor within the viewable surface comprises reducing one or more components of the translation vector to maintain the cursor at least a predetermined distance from the edge of the viewable surface.

6. The motion controlled handheld device of claim 1, wherein the display control module is further operable to detect a value of the third component exceeding a threshold and, in response, to perform an operation based on a current location of the cursor with respect to the current image.

7. The motion controlled handheld device of claim 1, further comprising:

a first accelerometer operable to detect acceleration along a first axis;

a second accelerometer operable to detect acceleration along a second axis, the second axis perpendicular to the first axis; and

a third accelerometer operable to detect acceleration along a third axis, the third axis perpendicular to the first axis and perpendicular to the second axis; and

wherein;

the gesture database further defines each of the gestures using a sequence of accelerations;

the motion detection module is further operable to detect motion of the device using accelerations measured by the first accelerometer, the second accelerometer, and the third accelerometer; and

the motion response module is further operable to match the accelerations measured by the motion detection module against gesture definitions in the gesture database to identify particular ones of the gestures.

8. A method for controlling a handheld device comprising:

generating an image on a viewable surface of the handheld device;

detecting motion of the device within three dimensions;

identifying components of the motion in relation to the viewable surface, the components comprising a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface;

displaying a cursor on the viewable surface;

determining a translation vector that is substantially opposite to the sum of the first component and the second component;

translating the cursor across the viewable surface according to the translation vector in order to substantially maintain the position of the cursor in space with respect to the viewable surface;

storing a plurality of gestures in a gesture database, each gesture defined by a motion of the device with respect to a first position of the device;

mapping each of the gestures to a corresponding command;

identifying a matching one of the gestures based on the motion and to determine a corresponding one of the commands based on the identified gesture;

logically parsing a viewable image into a plurality of grid sections;

setting one of the grid sections as the current image; and

setting another one of the grid sections as the current image in response to the determined command.

9. The method of claim 8, further comprising maintaining the current image while the cursor translates across the viewable surface.

10. The method of claim 8, further comprising freezing translation of the cursor across the viewable surface in response to a command.

11. The method of claim 8, further comprising determining that the translation vector indicates translation of the cursor past an edge of the viewable surface and, in response, reducing a magnitude of the translation vector to maintain the cursor within the viewable surface.

12. The method of claim 8, further comprising detecting a value of the third component exceeding a threshold and, in response, performing an operation based on a current location of the cursor with respect to the current image.

13. The method of claim 8, further comprising:

detecting acceleration along a first axis;

detecting acceleration along a second axis, the second axis perpendicular to the first axis; and

detecting acceleration along a third axis, the third axis perpendicular to the first axis and perpendicular to the second axis;

detecting motion of the device using accelerations measured by the first accelerometer, the second accelerometer, and the third accelerometer; and

matching the accelerations against gesture definitions in the gesture database to identify potential indicated ones of the gestures.

14. Logic for controlling a handheld device, the logic embodied as a computer program stored on a computer readable medium and operable when executed to perform the steps of:

generating an image on a viewable surface of the handheld device;

detecting motion of the device within three dimensions;

identifying components of the motion in relation to the viewable surface, the components comprising a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface;

displaying a cursor on the viewable surface;

determining a translation vector that is substantially opposite to the sum of the first component and the second component;

translating the cursor across the viewable surface according to the translation vector in order to substantially maintain the position of the cursor in space with respect to the viewable surface;

storing a plurality of gestures in a gesture database, each gesture defined by a motion of the device with respect to a first position of the device;

mapping each of the gestures to a corresponding command;

identifying a matching one of the gestures based on the motion and to determine a corresponding one of the commands based on the identified gesture;

logically parsing a viewable image into a plurality of grid sections;

setting one of the grid sections as the current image; and

setting another one of the grid sections as the current image in response to the determined command.

15. The logic of claim 14, further operable when executed to perform the step of maintaining the current image while the cursor translates across the viewable surface.

16. The logic of claim 14, further operable when executed to perform the step of freezing translation of the cursor across the viewable surface in response to a command.

17. The logic of claim 14, further operable when executed to perform the steps of determining that the translation vector indicates translation of the cursor past an edge of the viewable surface and, in response, reducing a magnitude of the translation vector to maintain the cursor within the viewable surface.

18. The logic of claim 14, further operable when executed to perform the steps of detecting a value of the third component exceeding a threshold and, in response, performing an operation based on a current location of the cursor with respect to the current image.

19. The logic of claim 14, further operable when executed to perform the steps of:

detecting acceleration along a first axis;

detecting acceleration along a second axis, the second axis perpendicular to the first axis; and

detecting acceleration along a third axis, the third axis perpendicular to the first axis and perpendicular to the second axis;

detecting motion of the device using accelerations measured by the first accelerometer, the second accelerometer, and the third accelerometer; and

matching the accelerations against gesture definitions in the gesture database to identify potential indicated ones of the gestures.

20. A motion controlled handheld device comprising:

means for generating an image on a viewable surface of the handheld device;

means for detecting motion of the device within three dimensions;

means for identifying components of the motion in relation to the viewable surface, the components comprising a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface;

means for displaying a cursor on the viewable surface;

means for determining a translation vector that is substantially opposite to the sum of the first component and the second component;

means for translating the cursor across the viewable surface according to the translation vector in order to substantially maintain the position of the cursor in space with respect to the viewable surface;

means for storing a plurality of gestures in a gesture database, each gesture defined by a motion of the device with respect to a first position of the device;

means for mapping each of the gestures to a corresponding command;

means for identifying a matching one of the gestures based on the motion and to determine a corresponding one of the commands based on the identified gesture;

means for logically parsing a viewable image into a plurality of grid sections;

means for setting one of the grid sections as the current image; and

means for setting another one of the grid sections as the current image in response to the determined command.