REMOTE CONTROL OF HOST APPLICATION USING MOTION AND VOICE COMMANDS

• US 20110001699A1
• Filed: 05/05/2010
• Published: 01/06/2011
• Est. Priority Date: 05/08/2009
• Status: Active Grant

• Current Assignee: Kopin Corporation
• Original Assignee: Kopin Corporation
• Inventors: Jacobsen, Jeffrey J., Parkinson, Christopher, Pombo, Stephen A.
• Granted Patent: US 9,235,262 B2
• Time in Patent Office: Days
• US Class Current: 345/157
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A remote control microdisplay device that uses hand and head movement and voice commands to control the parameters of a field of view for the microdisplay within a larger virtual display area associated with a host application.

Claims

1. A hand-portable device comprising:

a microdisplay, for displaying visual information received from a local processor;

a motion detector, for detecting physical movement of a body part of a user, and to provide a motion input; and

the local processor located in the hand-portable apparatus and further comprising;

a receiver, for receiving the motion input;

a translator, for translating the motion input to a user command;

a communication interface, for forwarding host commands to a host processor, and for receiving a reply from the host processor;

a display controller, for forwarding information to be displayed on the microdisplay, including at least a visual confirmation of the local processor having processed the user command.

2. The apparatus of claim 1 further comprising:

a microphone, for receiving audio signals from the user, and

wherein the local processor further comprises;

a speech recognizer, for processing the audio signals to produce a voice command; and

wherein the translator further combines the voice command with the motion input to determine the host command.

3. The apparatus of claim 1 wherein the motion detector provides two or more motion inputs indicative of motion in two or more dimensions.

4. The apparatus of claim 1 wherein the communication interface is a wireless link between the hand-portable device and the host processor.

5. The apparatus of claim 1 wherein the motion detector is a camera for detecting hand movement of the user.

6. The apparatus of claim 1 wherein the motion detector is a head movement tracking device for detecting head movement of the user.

7. The apparatus of claim 1 wherein the user command is processed by the local processor to control aspect of the presentation of visual information displayed on the microdisplay.

8. The apparatus of claim 7 wherein the user command controls a field of view.

9. The apparatus of claim 7 wherein the user command controls a zoom, pan, or scale factor.

10. The apparatus of claim 7 wherein the user command selects an item.

11. The apparatus of claim 10 wherein the item is a hyperlink.

12. The apparatus of claim 1 wherein the user command is forwarded as a host command to the host processor.

13. The apparatus of claim 12 wherein the reply results in a cursor movement.

14. A method for operating a hand-portable device having a microdisplay, a motion detector, a wireless communication interface, and a local processor,

displaying visual information received from the local processor on a microdisplay;

using the motion detector for detecting physical movement of a body part of a user as a motion input to the local processor;

translating the motion input to a user command; and

controlling aspects of the visual information presented on the microdisplay based on the user command.

15. The method of claim 14 wherein the aspect of the visual information is a field of view.

16. The method of claim 14 wherein the aspect of the visual information is a zoom, pan, or scale factor.

17. The method of claim 14 additionally comprising:

forwarding the user command to a host processor using the wireless interface.

18. The method of claim 14 wherein the motion detector provides two or more motion inputs indicative of motion of the user in two or more dimensions.

19. The method of claim 14 wherein the motion detector is a camera for detecting hand movement of the user.

20. The method of claim 14 wherein the motion detector is a head movement tracking device for detecting head movement of the user.