Headset computer (HSC) as auxiliary display with ASR and HT input

• US 8,929,954 B2
• Filed: 03/13/2013
• Issued: 01/06/2015
• Est. Priority Date: 04/25/2012
• Status: Active Grant

• Current Assignee: Kopin Corporation
• Original Assignee: Kopin Corporation
• Inventors: Jacobsen, Jeffrey J., Parkinson, Christopher, Pombo, Stephen A., Woodall, James, Hollick, David
• Primary Examiner(s): Bilodeau, David
• Application Number:
  US13/799,570
• Publication Number:
  US 20130288753A1
• Time in Patent Office: 664 Days
• Field of Search: 455/563
• US Class Current: 455/563
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04M 1/724097 Worn on the head
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces

Abstract

The present invention related to human/computer interfaces and more particularly to a headset computing display device that accepts voice commands and tracks head motions to provide command inputs to and receive display information from a software application executed on a host computing device. An example embodiment of the present invention includes a method of, and corresponding system for, operating a native Smartphone or PC application, simultaneously displaying an output of the application through the Smartphone or PC screen and a headset computing display device, and using speech and head tracking commands to control the native application. The present invention enables hands-free operation of a Smartphone or PC application.

Claims

1. A method of operating a Smartphone application comprising:

executing a native application on a Smartphone;

generating output of the native application for simultaneously display through the Smartphone and through a headset computer;

in response to receiving the generated output at the headset computer, translating the received output for rendering in the headset domain;

operating the headset computer in a speech recognition and head tracking user interface mode;

monitoring for user speech recognition and head tracking commands from an end-user at the headset computer;

in response to received speech recognition and head tracking commands, translating the received speech recognition and head tracking commands to equivalent Smartphone commands at the headset computer and transmitting said equivalent Smartphone command to the Smartphone to control the native application.

2. The method of claim 1, wherein the generated output for display through the headset computer includes a markup language file.

3. The method of claim 2, wherein the markup language is HyperText Markup Language 5 (HTML5).

4. The method of claim 1, wherein the translating the received output for rendering in the headset domain results in presenting to the end-user menu selections and prompts in terms of the speech recognition and head tracking user interface commands.

5. The method of claim 4, wherein the menu selections and prompts are audibly and visually presented to the end-user.

6. The method of claim 1, wherein the receiving by the headset computer and the transmitting by the headset computer are performed wirelessly.

7. The method of claim 6, wherein the receiving by the headset computer and the transmitting by the headset computer are performed wirelessly using Bluetooth or Wi-Fi standards.

8. The method of claim 1, wherein the translations by the headset computer effectively enable speech recognition and hands-free user interface with the executed native Smartphone application.

9. The method of claim 1, wherein:

the executed native Smartphone application employs touch-type user interface commands; and

the headset translating to equivalent Smartphone commands includes translating from speech recognition and head tracked commands to touch type commands.

10. A method of claim 1, wherein the executed native Smartphone application is an image and/or video viewing application and the equivalent Smartphone commands transmitted by the headset computer include a command to display an image and/or video through the Smartphone.

11. A method of claim 1, wherein the native Smartphone application is configured to receive multi-media content driven from the headset computer.

12. A method of operating a Smartphone display comprising:

executing a native image and video viewing application on a Smartphone;

operating a headset computer in a speech recognition and head tracking user interface mode;

monitoring for user speech recognition and head tracking commands from an end-user at the headset computer;

in response to received speech recognition and head tracking commands, translating the received speech recognition and head tracking commands to an equivalent Smartphone command at the headset computer, the equivalent Smartphone command including capturing an image or video displayed on a micro-display of the headset computer;

transmitting the equivalent Smartphone command to the Smartphone to control the native image and video viewing application; and

displaying the captured image or video through the headset computer and through the Smartphone.

13. A dual display system comprising:

a Smartphone including a native display and a Smartphone communications module;

a native application, executed by the Smartphone, generating a display output communicated by the Smartphone communications module to a headset computing device for simultaneous display through the Smartphone native display and through a headset computing device;

the headset computing device including a micro-display and headset communications module;

a speech recognition and head tracking user interface used by the headset computing device for receiving end-user commands;

a translation module, executed by the headset computing device in response to receiving the display output communicated to the headset communications module, translating the display output for rendering through the micro-display and translating the received end-user commands to equivalent Smartphone commands; and

the headset communications module communicating the equivalent Smartphone commands to the Smartphone communications module to control the native application.

14. The dual display system of claim 13, wherein the display output includes a markup language file.

15. The dual display system of claim 14, wherein the markup language is HyperText Markup Language 5 (HTML5).

16. The dual display system of claim 13, wherein the display output for rendering through the micro-display includes menu selections and prompt in terms of speech recognition and head tracking user interface for the end-user.

17. The dual display system of claim 16, wherein the menu selections and prompts are audibly and visually presented to the end-user.

18. The dual display system of claim 13, wherein the Smartphone communications module and the headset communications module are wireless communications modules.

19. The dual display system of claim 18, wherein the wireless communications modules are Bluetooth or Wi-Fi modules.

20. The dual display system of claim 13, wherein the headset computing device effectively enables the speech recognition and head tracking user interface to control the native application.

21. The dual display system of claim 13, wherein the native application uses a touch-type user interface commands and the translation module translates the received speech recognition and head tracking user interface end-user commands to the touch-type user interface commands.

22. The dual display system of claim 13, wherein the native Smartphone application is an image and/or video viewing application and the equivalent Smartphone commands include a command to display an image and/or video through the native display of the Smartphone.

23. The dual display system of claim 13 wherein the native Smartphone application is configured to receive multi-media content from the headset computing device.