REAL-TIME REMODELING OF USER VOICE IN AN IMMERSIVE VISUALIZATION SYSTEM
First Claim
Patent Images
1. A method comprising:
- displaying, by a head-mounted display device, an image of a physical thing to a user of the head-mounted display device, wherein the physical thing is not actually present in a real-world environment of the user;
inputting voice of the user via a microphone of the head-mounted display device, while the image of the physical thing is being displayed to the user;
dynamically processing user voice data representing the voice of the user in real-time to incorporate an audio effect corresponding to the physical thing, while the image of the physical thing is being displayed to the user; and
outputting, via a speaker, in real-time, sound representing the voice of the user as would be affected by the physical thing if the physical thing were actually present in the real-world environment of the user, based on the dynamically processed user voice data, while the image of the physical thing is being displayed to the user.
0 Assignments
0 Petitions
Accused Products
Abstract
A visualization system with audio capability includes one or more display devices, one or more microphones, one or more speakers, and audio processing circuitry. While a display device displays an image to a user, a microphone inputs an utterance of the user, or a sound from the user'"'"'s environment, and provides it to the audio processing circuitry. The audio processing circuitry processes the utterance (or other sound) in real-time to add an audio effect associated with the image to increase realism, and outputs the processed utterance (or other sound) to the user via the speaker in real-time, with very low latency.
-
Citations
20 Claims
-
1. A method comprising:
-
displaying, by a head-mounted display device, an image of a physical thing to a user of the head-mounted display device, wherein the physical thing is not actually present in a real-world environment of the user; inputting voice of the user via a microphone of the head-mounted display device, while the image of the physical thing is being displayed to the user; dynamically processing user voice data representing the voice of the user in real-time to incorporate an audio effect corresponding to the physical thing, while the image of the physical thing is being displayed to the user; and outputting, via a speaker, in real-time, sound representing the voice of the user as would be affected by the physical thing if the physical thing were actually present in the real-world environment of the user, based on the dynamically processed user voice data, while the image of the physical thing is being displayed to the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method of operating a head-mounted display device with audio capability, the method comprising:
-
displaying, by the head-mounted display device, an image depicting a physical thing to a user of the head-mounted display device, wherein the physical thing is not actually present in the environment of the user; inputting voice of the user by using an array of microphones of the head-mounted display device, while the image of the physical thing is being displayed to the user; dynamically modifying user voice data representing the voice of the user to incorporate an audio effect that corresponds to an acoustic property of the physical thing, while the image of the physical thing is being displayed to the user; and outputting sound to the user, via a speaker of the head-mounted display device, based on the modified user voice data, to produce an audible effect applied to the voice of the user corresponding to the acoustic property of the physical thing, while the image of the physical thing is being displayed to the user. - View Dependent Claims (12, 13, 14)
-
-
15. A head-mounted display device comprising:
-
a head fitting by which to mount the head-mounted display device to the head of a user; a display element, coupled to the head fitting and configured to display to the user an image, the image depicting a physical thing that is not actually present in a real-world environment of the user; a plurality of microphones to input voice of the user while the image of the physical thing is being displayed to the user; a processor configured to access and dynamically modify user voice data representing the voice of the user in real-time to incorporate an audio effect corresponding to the physical thing, while the image of the physical thing is being displayed to the user; and a speaker subsystem to output sound to the user based on the modified user voice data while the image of the physical thing is being displayed to the user, the sound representing the voice of the user as would be affected by the physical thing if the physical thing were actually present in the real-world environment of the user. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification