Vision-guided robots and methods of training them
First Claim
Patent Images
1. A vision-guided robot trainable, via interactions with a human trainer, to complete a specified task comprising visual recognition of an object, the robot comprising:
- a camera for capturing camera views of the object;
a control system for (i) automatically selecting, based at least in part on an analysis of pixels within a visual outline of the object in a camera view thereof, a visual model from among a plurality of computer-implemented visual models each including an associated algorithm, the associated algorithm for each visual model being distinct from the other algorithms, and (ii) generating a representation of the object in accordance with the selected model, and (iii) identifying the object in a camera view thereof based on the model; and
a user interface comprising (i) a robot-controlled visual display for displaying the identification of the object, and (ii) at least one input device for receiving feedback from the trainer indicating whether the identification is correct.
1 Assignment
0 Petitions
Accused Products
Abstract
Via intuitive interactions with a user, robots may be trained to perform tasks such as visually detecting and identifying physical objects and/or manipulating objects. In some embodiments, training is facilitated by the robot'"'"'s simulation of task-execution using augmented-reality techniques.
-
Citations
13 Claims
-
1. A vision-guided robot trainable, via interactions with a human trainer, to complete a specified task comprising visual recognition of an object, the robot comprising:
-
a camera for capturing camera views of the object; a control system for (i) automatically selecting, based at least in part on an analysis of pixels within a visual outline of the object in a camera view thereof, a visual model from among a plurality of computer-implemented visual models each including an associated algorithm, the associated algorithm for each visual model being distinct from the other algorithms, and (ii) generating a representation of the object in accordance with the selected model, and (iii) identifying the object in a camera view thereof based on the model; and a user interface comprising (i) a robot-controlled visual display for displaying the identification of the object, and (ii) at least one input device for receiving feedback from the trainer indicating whether the identification is correct. - View Dependent Claims (2, 3)
-
-
4. A method of training a robot to complete a specified task comprising selection of an object, the robot having a machine-vision system for capturing images within a camera field of view, the method comprising:
-
(a) based on at least one image in the field of view, automatically computationally selecting a visual model from among a plurality of computer-implemented visual models, each of the visual models including an associated algorithm, the associated algorithm for each visual model being distinct from the other algorithms; (b) determining whether an object in the image can be validly detected using the selected visual model, and (i) if so, generating a representation of at least one object in the field of view in accordance with the selected model; and
(ii) if not, determining whether all visual models have previously been selected; and
(A) if all visual models have not previously been selected, repeating step (a), and (B) if all visual models have previously been selected, reporting an unsuccessful result;(c) if an object in the image has been validly detected, (i) displaying the object on a robot-controlled visual display;
(ii) based on the display, providing feedback to the robot indicating whether the selection is correct; and
(iii) repeating steps (c)(i) and (c)(ii) until the selection is correct. - View Dependent Claims (5, 6, 7, 8, 9)
-
-
10. A vision-guided robot trainable, via interactions with a human trainer, to complete a specified task comprising selection of an object, the robot comprising:
-
(a) a machine-vision system comprising at least one camera for capturing images within a camera field of view and an image processor for identifying objects within the captured images, the image processor being configured to automatically computationally select a visual model from among a plurality of computer-implemented visual models, each of the visual models including an associated algorithm, the associated algorithm for each visual model being distinct from the other algorithms; (b) a user interface comprising (i) a robot-controlled visual display and (ii) at least one input device for receiving feedback; and (c) a controller for controlling and, in response to the feedback, modifying the selection until the selection is correct and thereupon (i) associating, with the at least one object in the field of view, contextual information specifying visual characteristics of the object and (ii) storing the contextual information for subsequent executions, wherein the image processor is further configured to determine whether an object in the image can be validly detected using the selected visual model, and (i) if so, to cause the robot-controlled visual display to display the image and a selection of an object by the robot, and (ii) if not, to determine whether all visual models have previously been selected, and (A) if all visual models have not previously been selected, to select a new visual model, and (B) if all visual models have previously been selected, to report an unsuccessful result. - View Dependent Claims (11, 12, 13)
-
Specification