Annotating images with instructions
First Claim
Patent Images
1. A method executed by a computer processor, the method comprising:
- receiving a first image of a first object from a computing device of a first user, the first image having first annotations thereon relative to a first location of the first object, the first annotations generated by the first user, the first annotations being instructions for performing a first step in a task;
receiving a second image of the first object from the computing device of the first user, the second image having second annotations thereon relative to a second location of the first object, the second annotations generated by the first user, the second annotations being instructions for performing a second step in the task;
receiving an indication from a second user that the second user desires to complete the task;
subsequent to receiving the first image, the second image, and the indication, receiving a first image of a second object captured by a mobile computing device of the second user by way of a network, the second object corresponding to but being different than the first object in the first image;
responsive to receipt of the first image of the second object, accessing the first image of the first object;
transferring the first annotations from the first image of the first object to the first image of the second object to create a first annotated image of the second object, the first annotations positioned relative to the second object in the first image of the second object at a third location that corresponds to the first location relative to the first object in the first image of the first object;
transmitting the first annotated image of the second object to the mobile computing device of the second user by way of the network;
receiving an indication from the second user that the first step in the task has been completed but the task is incomplete;
receiving a second image of the second object from the mobile computing device by way of the network subsequent to receiving the indication from the user that the first step in the task has been completed but the task is incomplete;
transferring the second annotations from the second image of the first object to the second image of the second object to create a second annotated image of the second object, the second annotations positioned relative to the second object in the second image of the second object at a fourth location that corresponds to the second location relative to the first object in the first image; and
transmitting the second annotated image of the second object to the mobile computing device by way of the network.
2 Assignments
0 Petitions
Accused Products
Abstract
A method described herein includes the acts of receiving an image captured by a mobile computing device and automatically annotating the image to create an annotated image, wherein annotations on the annotated image provide instructions to a user of the mobile computing device. The method further includes transmitting the annotated image to the mobile computing device.
-
Citations
20 Claims
-
1. A method executed by a computer processor, the method comprising:
-
receiving a first image of a first object from a computing device of a first user, the first image having first annotations thereon relative to a first location of the first object, the first annotations generated by the first user, the first annotations being instructions for performing a first step in a task; receiving a second image of the first object from the computing device of the first user, the second image having second annotations thereon relative to a second location of the first object, the second annotations generated by the first user, the second annotations being instructions for performing a second step in the task; receiving an indication from a second user that the second user desires to complete the task; subsequent to receiving the first image, the second image, and the indication, receiving a first image of a second object captured by a mobile computing device of the second user by way of a network, the second object corresponding to but being different than the first object in the first image; responsive to receipt of the first image of the second object, accessing the first image of the first object; transferring the first annotations from the first image of the first object to the first image of the second object to create a first annotated image of the second object, the first annotations positioned relative to the second object in the first image of the second object at a third location that corresponds to the first location relative to the first object in the first image of the first object; transmitting the first annotated image of the second object to the mobile computing device of the second user by way of the network; receiving an indication from the second user that the first step in the task has been completed but the task is incomplete; receiving a second image of the second object from the mobile computing device by way of the network subsequent to receiving the indication from the user that the first step in the task has been completed but the task is incomplete; transferring the second annotations from the second image of the first object to the second image of the second object to create a second annotated image of the second object, the second annotations positioned relative to the second object in the second image of the second object at a fourth location that corresponds to the second location relative to the first object in the first image; and transmitting the second annotated image of the second object to the mobile computing device by way of the network. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system comprising:
-
a processor; and a memory that comprises a plurality of components that are executable by the processor, the components comprising; an annotator component that receives a first image of a first object from a mobile computing device of a first user by way of a network, wherein the first image of the first object corresponds to a multi-step task desirably undertaken with respect to the first object by the first user, wherein responsive to receiving the first image, the annotator component; accesses a first image of a second object from a data repository, the first image of the second object previously received from a computing device of a second user, the first image of the second object comprising first annotations generated by the second user and positioned in the first image of the second object at a first location relative to the second object, the second object corresponding to but different than the first object, the first annotations corresponding to a first step of the multi-step task; and automatically visually annotates the first image of the first object with the first annotations to generate a first annotated image of the first object, the annotator component transferring the first annotations from the first image of the second object to the first image of the first object to visually annotate the first image of the first object, the annotator component positioning the first annotations at a second location in the first image of the first object relative to the first object that corresponds to the first location in the first image of the second object; and a transmitter component that transmits the first annotated image to the mobile computing device of the first user by way of the network, wherein subsequent to the transmitter component transmitting the first annotated image to the mobile computing device of the user, the annotator component receives an indication from the first user that the first step is complete but the multi-step task is incomplete, and wherein the annotator component receives a second image of the first object from the first user and transfers second annotations from a second image of the second object to the second image of the first object to generate a second annotated image, the second annotations corresponding to a second step of the multi-step task, and wherein subsequent to the annotator component generating the second annotated image, the transmitter component transmits the second annotated image to the mobile computing device of the first user by way of the network. - View Dependent Claims (11, 12, 13, 14, 15, 16)
-
-
17. A computer-readable storage device comprising instructions that, when executed by a processor, cause the processor to perform acts comprising:
-
receiving, by way of a first network connection, a first image of a first object from a computing device of a first user, the first image of the first object comprising first annotations at a first location relative to the first object in the first image of the first object, the first annotations applied to the first image of the first object at the first location by the first user prior to receiving the first image of the first object, the first annotations being first instructions for completing a first step of a multi-step task; receiving, by way of the first network connection, a second image of the first object from the computing device of the first user, the second image of the first object comprising second annotations at a second location relative to the first object in the second image of the first object, the second annotations applied to the second image of the first object at the second location prior to receiving the second image, the second annotations being second instructions for completing a second step of the multi-step task; receiving a first image of a second object from a mobile computing device of a second user by way of a second network connection, the second object corresponding to but different from the first object; receiving input from the mobile computing device that the second object in the first image of the second object corresponds to the first object; responsive to receiving the input from the mobile computing device, extracting at least one feature from the first image of the second object; comparing the at least one feature extracted from the first image of the second object with a corresponding feature in the first image of the first object; determining orientation of the second object in the first image of the second object relative to the first object in the first image of the first object based upon the comparing of the at least one feature extracted from the first image of the second object with the corresponding feature in the first image of the first object; determining a second location in the first image of the second object that corresponds to the first location in the first image of the first object based at least in part upon the determining of the orientation of the second object in the first image of the second object relative to the first object in the first image of the first object; automatically transferring the first annotations from the first location in the first image of the first object to the second location in the first image of the second object responsive to determining the second location in the first image of the second object to create a first annotated image; transmitting the first annotated image to the mobile computing device by way of the second network connection; receiving a second image of the second object from the mobile computing device of the second user, wherein receiving the second image of the second object indicates that the first step in the multi-step task is complete but the task is incomplete; transferring the second annotations from the second image of the first object to the second image of the second object subsequent to receiving the second image of the second object to generate a second annotated image; and transmitting the second annotated image to the mobile computing device. - View Dependent Claims (18, 19, 20)
-
Specification