Vision augmentation for supplementing a person's view
First Claim
1. An augmentation system for supplementing a person'"'"'s view from a vehicle of an environment through which the vehicle travels, the augmentation system comprising:
- a sensor on the vehicle configured to generate sensor data, the sensor data representative of an object in the environment through which the vehicle travels;
a display; and
one or more processors configured to;
determine a direction of view of the person;
determine, based at least in part on the direction of view, a subset of the sensor data;
determine, based at least in part on the subset of the sensor data, a representation of the object in the environment through which the vehicle travels; and
cause the display to augment the person'"'"'s view of the environment through which the vehicle travels by presenting the subset of the sensor data superimposed with the representation of the object,wherein the representation of the object is indicative of at least one of a location of the object, one or more extents of the object, a type of the object, a historical path of the object, or a predicted path of the object.
1 Assignment
0 Petitions
Accused Products
Abstract
An augmentation system may supplement a person'"'"'s view from at least one of an actual vehicle or a virtual vehicle of an environment through which the vehicle travels. The system may include a receiver configured to receive data signals representative of operation of the vehicle and representative of objects in the environment through which the vehicle travels. The system may also include a converter in communication with the receiver. The converter may be configured to convert the data signals into display data representative of the operation of the vehicle and representative of the objects in the environment through which the vehicle travels. The converter may also be configured to communicate the display data to a display in communication with the converter and configured to display, within the person'"'"'s view from the vehicle, images representative of the display data to supplement the person'"'"'s view.
-
Citations
33 Claims
-
1. An augmentation system for supplementing a person'"'"'s view from a vehicle of an environment through which the vehicle travels, the augmentation system comprising:
-
a sensor on the vehicle configured to generate sensor data, the sensor data representative of an object in the environment through which the vehicle travels; a display; and one or more processors configured to; determine a direction of view of the person; determine, based at least in part on the direction of view, a subset of the sensor data; determine, based at least in part on the subset of the sensor data, a representation of the object in the environment through which the vehicle travels; and cause the display to augment the person'"'"'s view of the environment through which the vehicle travels by presenting the subset of the sensor data superimposed with the representation of the object, wherein the representation of the object is indicative of at least one of a location of the object, one or more extents of the object, a type of the object, a historical path of the object, or a predicted path of the object. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A method for supplementing a person'"'"'s view from at least one of an actual vehicle or a virtual vehicle of an environment through which the vehicle travels, the method comprising:
-
receiving data signals representative of operation of the vehicle and representative of objects in the environment through which the vehicle travels; converting the data signals into display data representative of the operation of the vehicle and representative of the objects in the environment through which the vehicle travels; displaying images representative of the operation of the vehicle and images representative of the objects in the environment through which the vehicle travels to a person to supplement the person'"'"'s view, such that the images representative of the operation of the vehicle and the images representative of the objects in the environment through which the vehicle travels are superimposed onto a representation of the environment to augment the person'"'"'s view of the environment; comparing, as a comparison, at least one of objects or vehicle motion displayed in the representation of the environment with the images representative of the operation of the vehicle and the images representative of the objects in the environment through which the vehicle travels; identifying, based at least in part on the comparison, differences between the objects displayed in the representation of the environment and the images representative of the operation of the vehicle and the images representative of the objects in the environment through which the vehicle travels; and controlling the vehicle based at least in part on the differences, wherein the images representative of the objects in the environment through which the vehicle travels comprise data associated with at least one of a location of the objects, types of the objects, historical paths of the objects, or predicted paths of the objects. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29)
-
-
30. A method for testing an autonomous vehicle, the method comprising:
supplementing a person'"'"'s view from the autonomous vehicle of an environment through which the autonomous vehicle travels, the autonomous vehicle comprising an actual vehicle, the supplementing comprising; receiving data signals representative of operation of the autonomous vehicle and representative of objects in the environment through which the autonomous vehicle travels; converting the data signals into images representative of the operation of the autonomous vehicle and images representative of the objects in the environment through which the autonomous vehicle travels; superimposing the images representative of the operation of the autonomous vehicle and the images representative of the objects in the environment through which the autonomous vehicle travels with the person'"'"'s view from the autonomous vehicle; comparing, as a comparison, actual objects viewable by the person from the autonomous vehicle with the images representative of the operation of the autonomous vehicle and the images representative of the objects in the environment through which the autonomous vehicle travels; and identifying, based at least in part on the comparison, differences between the actual objects and the images representative of the objects in the environment through which the autonomous vehicle travels. - View Dependent Claims (31, 32, 33)
Specification