Robotic system, robot control method and robot control program

• US 8,583,287 B2
• Filed: 01/08/2013
• Issued: 11/12/2013
• Est. Priority Date: 06/14/2011
• Status: Expired due to Fees

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Kase, Hiroshi, Otsuka, Michihiko, Horinouchi, Takashi
• Primary Examiner(s): Tran, Khoi
• Assistant Examiner(s): Lin, Abby
• Application Number:
  US13/736,520
• Publication Number:
  US 20130123987A1
• Time in Patent Office: 308 Days
• Field of Search: 446/175, 463/1, 463/29, 700245-264, 382/153, 901/1, 901 46- 47, 901/50, 706 45- 61
• US Class Current: 700/259
• CPC Class Codes: A63H 11/00 Self-movable toy figures
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: A63H 30/04 using wireless transmission
• CPC Class Codes: B25J 11/0005 Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
• CPC Class Codes: B25J 11/001 with emotions simulating means
• CPC Class Codes: B25J 13/003 by means of an audio-responsive input audible safety signals B25J19/061
• CPC Class Codes: B25J 9/1697 Vision controlled systems
• CPC Class Codes: G06N 3/008 based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. based on robots replicating pets or humans in their appearance or behaviour
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: Y10S 901/09 Closed loop, sensor feedback controls arm movement
• CPC Class Codes: Y10S 901/47 Optical

Abstract

A robotic system includes: a detection unit that detects at least one of a voice, light and an image of a content outputted by a content output device; a decision unit that assesses information detected by the detection unit on the basis of reference data so as to assess the content outputted by the content output device; and a control unit that controls a behavior or a state of the robotic system on the basis of the assessment made by the decision unit.

Claims

1. A robot comprising:

a detection unit that detects an image of a content outputted by a content output device;

a decision unit that recognizes a person included in the image of the content by matching the image detected by the detection unit with reference data that include a template image of the person, and groups the content according to the person recognized in the image;

a control unit that controls a behavior or a state of the robot based on the grouping made by the decision unit; and

a communication unit that communicates directly with the content output device independently of the detection unit; and

an external equipment control unit that controls the content outputted by the content output device through the communication unit based on the grouping made by the decision unit.

2. The robot according to claim 1, further comprising a setting unit that acquires setting information for communication with the content output device by analyzing the image outputted by the content output device.

3. The robot according to claim 2, wherein the setting information comprises access information for accessing to the content output device and certified information for obtaining access permission.

4. The robot according to claim 1, further comprising a search unit that acquires a shot image around the robot by the detection unit and recognizes a display screen of the content output device by recognizing a rectangle in the acquired shot image.

5. The robot according to claim 4, wherein when the robot is in an idle state continuously for a predetermined time, the search unit starts an action of the recognition.

6. The robot according to claim 1, wherein when at least one of the person and an action pattern of the person contained in the reference data is recognized in the images of the content detected by the detection unit, the decision unit increases or decreases a value indicating favorability of the robot with respect to the content;

and

the control unit controls the behavior or the state of the robot based on the favorability.

7. The robot according to claim 1, further comprising a reference data storage unit that stores as the reference data at least one of the person and an action pattern of the person detected in the image acquired by the detection unit.

8. The robot according to claim 1, further comprising:

a reference data acquisition unit that acquires, as the reference data, either data recorded in the content output device through the communication unit or data recorded on a location indicated by information recorded in the content output device.

9. The robot according to claim 1, further comprising a reference data update unit that updates the reference data based on the person recognized by the decision unit.

10. The robotic system according to claim 1, wherein the decision unit calculates a value indicating favorability of the robot with respect to the content;

and

the external equipment control unit controls a content being outputted or to be outputted by the content output device, by use of the value indicating the favorability.

11. The robot according to claim 1, wherein the decision unit detects an action pattern of the person from the image detected by the detection unit;

and

the control unit allows the robot to move in accordance with the action.

12. The robot according to claim 1, wherein when the decision unit judges that the content output by the content output device is suspended, the control unit allows the robot to perform a predetermined action.

13. The robot according to claim 6, wherein the decision unit groups contents further according to values indicating the favorability of the robot, and

the control unit allows the robot to output information indicating at least one of the grouped contents.

14. The robot according to claim 1, wherein the external equipment control unit controls the content output device to reproduce the content at a frequency according to the grouping made by the decision unit.

15. A robot control method comprising:

a detection step of detecting an image of a content outputted by a content output device;

a decision step, executed by a processor of a robot, of recognizing a person included in the image of the content by matching the image detected in the detection step with reference data that include a template image of the person, and grouping the content according to the person recognized in the image;

a control step of controlling a behavior or a state of the robot based on the grouping made by the decision step; and

an external equipment control step of controlling the content outputted by the content output device based on the grouping made by the decision unit through a communication unit that communicates directly with the content output device independently of the detection step.

16. A non-transitory recording medium that stores a robot control program for allowing a computer to execute:

a detection process of detecting an image of a content outputted by a content output device;

a decision process of recognizing a person included in the image of the content by matching the image detected in the detection process with reference data that include a template image of the person, and grouping the content according to the person recognized in the image;

a control process of controlling a behavior or a state of the robot based on the grouping made by the decision process; and

an external equipment control process of controlling the content outputted by the content output device based on the grouping made by the decision process through a communication unit that communicates directly with the content output device independently of the detection step.