Wearable Behavior-Based Vision System
First Claim
1. A see through display apparatus, comprising:
- a see-through, head mounted display;
a plurality of sensors cooperating with the display to detect audible and visual data in a field of view of the apparatus;
one or more processing devices in communication with display and the sensors, the one or more processing devices automaticallyestablish a plurality of behavioral zones relative to the apparatus;
determine at least one real object proximate to the apparatus, the at least one real object associated with one of the plurality of behavioral zones;
assign one or more behaviors with the real object based on the association; and
provide the one or more behaviors and the object to a feedback application for the apparatus.
2 Assignments
0 Petitions
Accused Products
Abstract
A see through display apparatus includes a see-through, head mounted display and sensors on the display which detect audible and visual data in a field of view of the apparatus. A processor cooperates with the display to provide information to a wearer of the device using a behavior-based real object mapping system. At least a global zone and an egocentric behavioral zone relative to the apparatus are established, and real objects assigned behaviors that are mapped to the respective zones occupied by the object. The behaviors assigned to the objects can be used by applications that provide services to the wearer, using the behaviors as the foundation for evaluation of the type of feedback to provide in the apparatus.
-
Citations
20 Claims
-
1. A see through display apparatus, comprising:
-
a see-through, head mounted display; a plurality of sensors cooperating with the display to detect audible and visual data in a field of view of the apparatus; one or more processing devices in communication with display and the sensors, the one or more processing devices automatically establish a plurality of behavioral zones relative to the apparatus; determine at least one real object proximate to the apparatus, the at least one real object associated with one of the plurality of behavioral zones; assign one or more behaviors with the real object based on the association; and provide the one or more behaviors and the object to a feedback application for the apparatus. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer readable medium including instructions operable on a processing device to perform a method of providing a vision system comprising the steps of:
-
identifying a plurality of real objects in a global behavioral zone and in an egocentric behavioral zone; assigning one or more behaviors to each real object identified, the behavior comprising a primitive interaction rule for a wearer of a see through head mounted display and being dependent on an expected user behavior relative to the object in each behavioral zone; determining real objects proximate to a location of the see through head mounted display; and for at least the real object proximate to the location, providing the behaviors and the real object to a feedback application for the system. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
-
16. A computer implemented method defining a plurality of real objects relative to a processing device, the processing device including a display, comprising:
-
defining a plurality of behaviors for a global behavioral zone; defining a plurality of behaviors for an egocentric behavioral zone; identifying a plurality of real objects in a global behavioral zone and in an egocentric behavioral zone; assigning one or more of the plurality of behaviors for the global behavioral zone to each real object identified in the global behavioral zone determining real objects proximate to a location of the processing device assigning one or more of the plurality of behaviors for the egocentric behavioral zone to each real object determined to be in the egocentric behavioral zone; and providing the behaviors and the real object to a feedback application. - View Dependent Claims (17, 18, 19, 20)
-
Specification