Apparatus and method for automatic action selection based on image context
First Claim
1. An apparatus for providing context-related feedback to a user, the apparatus comprising:
- an image sensor configured to capture real time image data from an environment of the user;
at least one processor device configured to;
identify in the image data a hand-related trigger, wherein multiple context-based alternative actions are associated with the hand-related trigger;
identify in the image data an object based on the hand-related trigger, wherein the object is associated with a particular context;
select one of the multiple alternative actions associated with the hand-related trigger based on the particular context associated with the identified object,execute the selected alternative action; and
output the context-related feedback based on a result of the executed alternative action.
1 Assignment
0 Petitions
Accused Products
Abstract
Devices and a method are provided for providing context-related feedback to a user. In one implementation, the method comprises capturing real time image data from an environment of the user. The method further comprises identifying in the image data a hand-related trigger. Multiple context-based alternative actions are associated with the hand-related trigger. Further, the method comprises identifying in the image data an object associated with the hand-related trigger. The object is further associated with a particular context. Also, the method comprises selecting one of the multiple alternative actions based on the particular context. The method further comprises outputting the context-related feedback based on a result of the executed alternative action.
14 Citations
24 Claims
-
1. An apparatus for providing context-related feedback to a user, the apparatus comprising:
-
an image sensor configured to capture real time image data from an environment of the user; at least one processor device configured to; identify in the image data a hand-related trigger, wherein multiple context-based alternative actions are associated with the hand-related trigger; identify in the image data an object based on the hand-related trigger, wherein the object is associated with a particular context; select one of the multiple alternative actions associated with the hand-related trigger based on the particular context associated with the identified object, execute the selected alternative action; and output the context-related feedback based on a result of the executed alternative action. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. An apparatus for providing context-related feedback to a user, the apparatus comprising:
-
an image sensor configured to be worn by the user and to capture real time image data from an environment of the user; at least one processor device configured to; identify a trigger in the image data, wherein multiple context-based alternative actions are associated with the trigger; identify an object in the image data based on the trigger; identify a background of the object in the image data; determine a particular context using information about at least one of the identified object and the identified background; select one of the multiple alternative actions associated with the trigger based on the particular context associated with the identified object; execute the selected alternative action; and output the context-related feedback based on a result of the executed alternative action. - View Dependent Claims (17, 18, 19, 20, 21, 22)
-
-
23. A method for providing context-related feedback to a user, the method comprising:
-
capturing real time image data from an environment of the user; identifying in the image data a hand-related trigger, wherein multiple context-based alternative actions are associated with the hand-related trigger; identifying in the image data an object based on the hand-related trigger, wherein the object is further-associated with a particular context; selecting one of the multiple alternative actions associated with the hand-related trigger based on the particular context associated with the identified object; and outputting the context-related feedback based on a result of the executed alternative action. - View Dependent Claims (24)
-
Specification