Video noise reduction for video augmented reality system
First Claim
1. A head mounted display device, comprising:
- a display unit;
a camera, having a fast shutter speed, for generating frames of display data during movement of a user'"'"'s head;
a memory comprising a frame store for storing a previous frame of displayed information that was sent to the display unit; and
a motion processor in communication with the camera, display unit, and the frame store, wherein the motion processor is operable to;
identify a first area of interest in a current frame of display data, wherein the first area of interest is a first portion of the current frame, wherein the first area of interest is identified by eye tracking the first portion of the current frame at which a user of the head mounted display is looking, wherein a location of the first area of interest moves based on movement of a user'"'"'s eyes;
identify a second area of interest, similar to the first area of interest, in the previous frame stored in the frame store, wherein the second area of interest is identified by eye tracking a second portion of the previous frame at which the user of the head mounted display was looking;
rotate and translate the second area of interest, from the previous frame stored in the frame store, to match the first area of interest in the current frame;
average the second area of interest with the first area of interest to generate a displayed area of interest to increase light in the displayed area to compensate for the fast shutter speed; and
display the displayed area of interest.
1 Assignment
0 Petitions
Accused Products
Abstract
Video noise reduction for a video augmented reality system is provided. A head mounted display includes a display unit; a camera for generating frames of display data. A frame store is provided for storing previous frames of displayed information that was sent to the display unit; and a motion processor is provided in communication with the camera, display unit, and the frame store. The motion processor is operable to: identify an area of interest in a current frame of display data; match the area of interest to similar areas in previous frames stored in the frame store; rotate and translate the matched areas of interest from the one or more previous frames stored in the frame store to match the area of interest in the current frame; and average the prior matched areas of interest with the current area of interest to generate a displayed area of interest.
-
Citations
20 Claims
-
1. A head mounted display device, comprising:
-
a display unit; a camera, having a fast shutter speed, for generating frames of display data during movement of a user'"'"'s head; a memory comprising a frame store for storing a previous frame of displayed information that was sent to the display unit; and a motion processor in communication with the camera, display unit, and the frame store, wherein the motion processor is operable to; identify a first area of interest in a current frame of display data, wherein the first area of interest is a first portion of the current frame, wherein the first area of interest is identified by eye tracking the first portion of the current frame at which a user of the head mounted display is looking, wherein a location of the first area of interest moves based on movement of a user'"'"'s eyes; identify a second area of interest, similar to the first area of interest, in the previous frame stored in the frame store, wherein the second area of interest is identified by eye tracking a second portion of the previous frame at which the user of the head mounted display was looking; rotate and translate the second area of interest, from the previous frame stored in the frame store, to match the first area of interest in the current frame; average the second area of interest with the first area of interest to generate a displayed area of interest to increase light in the displayed area to compensate for the fast shutter speed; and display the displayed area of interest. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system comprising a computing device, the computing device comprising:
-
at least one processing device in communication with at least one camera, wherein the camera has a fast shutter speed, which causes frames of display data generated from the camera to have low light; and at least one computer readable data storage device storing instructions that, when executed by the at least one processing device are operative to; receive an image from the camera; determine a first area of interest in the image, wherein the first area of interest is a first portion of the current frame, wherein the first area of interest is identified by eye tracking the first portion of the current frame at which a user of the head mounted display is looking, wherein a location of the first area of interest moves based on movement of a user'"'"'s eyes; find a comparable second area of interest in a previous frame, wherein the second area of interest is identified by eye tracking a second portion of the previous frame at which the user of the head mounted display was looking; average the first area of interest in the image with the comparable second area of interest in the previous frame to increase light in the displayed area to compensate for the fast shutter speed; and display the averaged area of interest embedded within the image from the camera. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
-
16. A method comprising:
-
receiving a current image from a camera wherein the camera has a fast shutter speed, which causes frames of display data generated from the camera to have low light; retrieving from a frame store a previous image that was captured by the camera; determining a first area of interest, wherein the first area of interest is identified by eye tracking a first portion of the current frame at which a user of the head mounted display is looking, wherein a location of the first area of interest moves based on movement of a user'"'"'s eyes; finding a comparable second area of interest in the previous image, wherein the second area of interest is identified by eye tracking a second portion of the previous frame at which the user of the head mounted display was looking; averaging the first area of interest in the current image with the second area of interest in the previous image to create an averaged area of interest, wherein the averaging increases light in the averaged area to compensate for the fast shutter speed; and display the averaged area of interest. - View Dependent Claims (17, 18, 19, 20)
-
Specification