Mobile wireless display providing speech to speech translation and avatar simulating human attributes
First Claim
1. A head-wearable monocular display device comprising:
- a memory;
a portable, miniature display configured to display multimedia content, wherein the multimedia content comprises an output audio signal and a corresponding video signal, the output audio signal being synchronized with the corresponding video signal;
a speaker responsive to the output audio signal;
a microphone configured to receive an audio signal including speech;
a converter coupled to the microphone and configured to convert the received audio signal to a first digital representation of the audio signal, the first digital representation of the audio signal including language translation of the speech into a first language; and
a controller configured to;
(a) perform speech recognition of the first digital representation of the audio signal including recognizing the speech as translated into the first language;
(b) compare the first digital representation of the audio signal to a lookup table stored in the memory;
(c) convert the first digital representation of the audio signal to a control output based on the comparison, such that the control output is a function of the first language; and
(d) output the control output to components of the device and enable interaction between the device and at least one external host computing device; and
a wireless interface configured;
(i) to interrogate and establish a wireless connection between the device and the at least one host computing device, (ii) to initiate a request for multimedia content by transmitting the control output in the form of a request to the at least one host computing device for multimedia content made available at a host display interface, wherein the control output is a function of the first language, and (iii) to receive multimedia content from the at least one host computing device in response to the request for multimedia content,wherein the head-wearable monocular display device is non-occlusive, and wherein the received multimedia content contains a second digital representation of the audio signal including a language translation of the speech included in the audio signal, the language translation translating the speech into a second language, the controller further configured to convert the second digital representation of the audio signal to a voice modulated audio signal including speech in the second language, the display and the speaker being responsive to the controller and rendering text representing a second digital representation of the audio signal synchronized with the voice modulated audio signal including speech in a second language.
1 Assignment
0 Petitions
Accused Products
Abstract
An apparatus includes a monocular display with a wireless communications interface, user input device, transmitter, and controller, and may provide a video link to and control and management of a host device and other devices, such as a cell phone, computer, laptop, or media player. The apparatus may receive speech and digitize it. The apparatus may compare the digitized speech in a first language to a table of digitized speech in a second language to provide translation or, alternatively, may compare the digitized speech to a table of control commands. The control commands allow user interaction with the apparatus or other remote devices in a visual and audio manner. The control signals control a “recognized persona” or avatar stored in a memory to provide simulated human attributes to the apparatus, network or third party communication device. The avatar may be changed or upgraded according to user choice.
131 Citations
36 Claims
-
1. A head-wearable monocular display device comprising:
-
a memory; a portable, miniature display configured to display multimedia content, wherein the multimedia content comprises an output audio signal and a corresponding video signal, the output audio signal being synchronized with the corresponding video signal; a speaker responsive to the output audio signal; a microphone configured to receive an audio signal including speech; a converter coupled to the microphone and configured to convert the received audio signal to a first digital representation of the audio signal, the first digital representation of the audio signal including language translation of the speech into a first language; and a controller configured to; (a) perform speech recognition of the first digital representation of the audio signal including recognizing the speech as translated into the first language; (b) compare the first digital representation of the audio signal to a lookup table stored in the memory; (c) convert the first digital representation of the audio signal to a control output based on the comparison, such that the control output is a function of the first language; and (d) output the control output to components of the device and enable interaction between the device and at least one external host computing device; and a wireless interface configured;
(i) to interrogate and establish a wireless connection between the device and the at least one host computing device, (ii) to initiate a request for multimedia content by transmitting the control output in the form of a request to the at least one host computing device for multimedia content made available at a host display interface, wherein the control output is a function of the first language, and (iii) to receive multimedia content from the at least one host computing device in response to the request for multimedia content,wherein the head-wearable monocular display device is non-occlusive, and wherein the received multimedia content contains a second digital representation of the audio signal including a language translation of the speech included in the audio signal, the language translation translating the speech into a second language, the controller further configured to convert the second digital representation of the audio signal to a voice modulated audio signal including speech in the second language, the display and the speaker being responsive to the controller and rendering text representing a second digital representation of the audio signal synchronized with the voice modulated audio signal including speech in a second language. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A method of interacting a head-wearable monocular display device and at least one host computing device, the method comprising:
-
interrogating and establishing a wireless connection between a wireless interface at the display device and at the least one host computing device; transmitting a control output in the form of a request to the at least one host computing device for multimedia content made available at a host display interface, wherein the control output is a function of a first language; receiving multimedia content from the at least one host computing device in response to the request for multimedia content, wherein the received multimedia content comprises an output audio signal and a corresponding video signal, the output audio signal being synchronized with the corresponding video signal; receiving at the display device an audio signal including speech; converting the received audio signal to a first digital representation of the audio signal, the first digital representation of the audio signal including language translation of the speech into a first language; performing speech recognition of the first digital representation of the audio signal including recognizing the speech as translated into the first language; comparing the first digital representation of the audio signal to a lookup table stored in a memory; converting the first digital representation of the audio signal to a control output based on the comparison, such that the control output is a function of the first language; outputting the control output as the request for multimedia content, and enabling interaction between the display device and the at least one host computing device, and in response to receiving the multimedia content from the at least one host computing device, display the received multimedia content on a display of the display device, wherein the head-wearable monocular display device is non-occlusive, and wherein the received multimedia content contains a second digital representation of the audio signal including a language translation of speech included in the audio signal into a second language; converting the second digital representation of the audio signal to a voice modulated audio signal including speech in the second language; and playing the voice modulated audio signal including speech in the second language at a speaker of the monocular display device while displaying text representing a second digital representation of the audio signal synchronized with the voice modulated audio signal including speech in a second language. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34)
-
-
35. A system for providing multimedia content to a user, the system comprising:
-
at least one host computing device, including a host display interface and a first wireless interface configured to respond to an interrogation and establish a wireless connection between the at least one host computing device and an external device, the at least one host computing device configured to provide to the external device multimedia content made available at the host display interface of the at least one host computing device, and the first wireless interface further configured to receive a request for multimedia content from the external device and transmit multimedia content to the external device in response to the request for multimedia content, wherein the transmitted multimedia content comprises an output audio signal and a corresponding video signal, the output audio signal being synchronized with the corresponding video signal; and a non-occlusive head-wearable monocular display device including;
(1) a portable, miniature display configured to display multimedia content, (2) a second wireless interface configured to establish a wireless connection between the head-wearable monocular display device and at the least one host computing device, the second wireless interface further configured to;
(i) interrogate and establish a wireless connection with the at least one host computing device, (ii) transmit the request to the at least one host computing device for multimedia content made available at the host display interface of the at least one host computing device, wherein a control output is a function of the first language, and (iii) receive multimedia content from the at least one host computing device transmitted in response to the request for multimedia content, (3) a speaker responsive to the output audio signal, (4) a microphone configured to receive an audio signal including speech, (5) a converter coupled to the microphone and configured to convert the received audio signal to a first digital representation of the audio signal, and the first digital representation of the audio signal including language translation of the speech into a first language, and (6) a controller configured to;(a) perform speech recognition including recognizing the speech as translated into the first language; (b) compare the first digital representation of the audio signal to a lookup table stored in the memory; (c) convert the first digital representation of the audio signal to a control output based on the comparison, such that the control output is a function of the first language; and (d) output the control output to components of the apparatus to enable interaction with at least one of the head-wearable monocular display device, the at least one host computing device, and external devices, wherein the received multimedia content contains the second digital representation of the received audio signal including a language translation of speech included in said audio signal into the second language, the controller further configured to convert the second digital representation of the audio signal to a voice modulated audio signal including speech in the second language, the miniature display and the speaker being responsive to the controller and rendering text representing a second digital representation of the audio signal synchronized with the voice modulated audio signal including speech in a second language.
-
-
36. A computer readable medium containing computer readable instructions that, when executed by a computer, cause the computer to:
-
establish a wireless connection with at least one host computing device; transmit a control output in the form of a request to the at least one host computing device for multimedia content made available at a host display interface, wherein the multimedia content comprises an output audio signal and a corresponding video signal, the output audio signal being synchronized with the corresponding vide signal; convert a received audio signal including speech to a first digital representation of the audio signal, the first digital representation of the audio signal including language translation of the speech into a first language; compare the first digital representation of the audio signal to a lookup table stored in a memory; convert the first digital representation of the audio signal to a control output based on the comparison, such that the control output is a function of the first language; output the control output and enable interaction with at least one of the computer, at least one host computing device, and external devices, the interaction including receiving multimedia content from the at least one host computing device, and wherein the received multimedia content contains a second digital representation of the received audio signal including a language translation of the speech included in the audio signal into a second language; convert the second digital representation of the audio signal to a voice modulated audio signal including speech in the second language; and render the voice modulated audio signal including speech in the second language at a speaker while rendering at a display monitor text representing a second digital representation of the audio signal synchronized with the voice modulated audio signal including speech in a second language.
-
Specification