Motion detection and tracking system to control navigation and display of portable displays including on-chip gesture detection

• US 20060061551A1
• Filed: 09/12/2005
• Published: 03/23/2006
• Est. Priority Date: 02/12/1999
• Status: Abandoned Application

• Current Assignee: Rembrandt Portable Display Technologies, LP (Rembrandt IP Management, LLC)
• Original Assignee: Vega Vista, Inc.
• Inventors: Fateh, Sina
• Application Number:
  US11/225,877
• Publication Number:
  US 20060061551A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A computer program, system and method to track motion and control navigation and display of an object viewer. Information content generated by a digital processor is mapped into a virtual display space suitable for conveying the information to a user. A certain portion of the virtual display space is displayed using a display device coupled to the digital processor. An image capture device captures an image from which a reference navigation target is acquired. Tracked movement of a display device relative to the reference navigation target is used to update the displayed certain portion of the virtual display space in a manner related to the tracked movement.

Claims

1. A computer implemented method for assisting a user in the control and operation of a computer system, said computer system having a display device, said computer implemented method comprising the acts of:

a) coupling said display device to a single digital image processor chip;

b) mapping information content into a virtual display space suitable for conveying said information to said user;

c) displaying a certain portion of said virtual display space using said display device;

d) capturing an image of a user with said digital image processor chip;

e) tracking movements of said user relative to said display device; and

f) updating said displayed certain portion of said virtual display space in a manner related to said tracked movements of said user,

whereby said computer system providing information content for display, said information content potentially containing more content such as characters, pictures, lines, links, video or pixels than can be conveniently displayed entirely on said display device at one time.

2. The computer implemented method as recited in claim 1 wherein said tracked movements of the user include a set of head movements which include one or more of the following:

a) nodding the head up;

b) nodding the head down,

c) turning the head to the left;

d) turning the head to the right; and

e) tilting the head at any angle.

3. The computer implemented method as recited in claim 2 wherein a display control command corresponds to each of a set of said tracked movements of said user.

4. The computer implemented method as recited in claim 1 wherein said digital image processor chip is mounted on said display device.

5. The computer implemented method as recited in claim 1 wherein a virtual magnification of said displayed certain portion is updated in response to a command entered into said digital processor by said user, said command corresponding to said movement of said user.

6. The computer implemented method as recited in claim 1 wherein a virtual orientation of said displayed certain portion is updated in a manner correlated to said tracked movement.

7. The computer implemented method as recited in claim 1 wherein a virtual orientation of said displayed certain portion is updated in response to a command entered into said digital processor by said user.

8. The computer implemented method as recited in claim 1 wherein an application executing upon said digital processor is a multi-dimensional object database application providing a virtual object.

9. The computer implemented method as recited in claim 8 wherein updating said displayed certain portion includes traversing said virtual object in at least one dimension.

10. The computer implemented method as recited in claim 1 wherein updating said displayed certain portion includes scaling said displayed certain portion.

11. The computer implemented method as recited in claim 10 wherein said displayed certain portion is scaled in response to a command entered into said computer system by said user.

12. The computer implemented method as recited in claim 1 wherein said display device and said digital processor are connected remotely by a wireless connection.

13. The computer implemented method as recited in claim 1 wherein said display device and said digital processor are disposed in a personal information appliance.

14. The computer implemented method as recited in claim 13 wherein said personal information appliance is a hand held computer.

15. The computer implemented method as recited in claim 13 wherein said personal information appliance is a mobile communication device.

16. The computer implemented method as recited in claim 13 wherein said personal information appliance has voice messaging capabilities.

17. The computer implemented method as recited in claim 13 wherein the personal information appliance has data messaging capabilities.

18. The computer implemented method as recited in claim 13 wherein said personal information appliance has handwriting recognition capability.

19. The computer implemented method as recited in claim 13 wherein said personal information appliance has voice recognition capability.

20. The computer implemented method as recited in claim 1 wherein said displayed certain portion includes multiple application windows.

21. A computer system comprising:

a) a digital image processor chip;

b) a computer memory coupled to said digital image processor chip;

c) a display device coupled to said digital image processor chip;

d) a motion detector;

e) a computer program embodied on said digital image processor chip, said computer program having computer executable instructions for;

i) mapping information content generated by said computer system into a virtual display space suitable for display on said display device;

ii) displaying a certain portion of said virtual display space via said display device;

iii) capturing an image of a user;

iv) tracking movements of said user relative to said display device; and

v) updating said displayed certain portion of said virtual display space in a manner correlated to said tracked movements of said user.

22-57. -57. (canceled)