Display control device, display control method, computer program product, and communication system

• US 9,067,315 B2
• Filed: 07/25/2012
• Issued: 06/30/2015
• Est. Priority Date: 08/02/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kawamoto, Kenta, Iwai, Yoshiaki, Shimizu, Satoru
• Primary Examiner(s): MANCHO, RONNIE M
• Application Number:
  US14/233,536
• Publication Number:
  US 20140200714A1
• Time in Patent Office: 1,070 Days
• Field of Search: 700/245, 700/246, 700/259, 700/257, 700/258, 700/213, 700/214, 700/228, 700/264, 318/568.12, 382/103, 382/115, 382/153, 901/1, 901/47
• US Class Current: 1/1
• CPC Class Codes: B25J 13/06 Control stands, e.g. consoles, switchboards
• CPC Class Codes: B25J 13/08 by means of sensing devices, e.g. viewing or touching devices
• CPC Class Codes: B25J 13/084 Tactile sensors in general G01L5/16, G01L5/22
• CPC Class Codes: B25J 5/007 mounted on wheels
• CPC Class Codes: B25J 9/0003 Home robots, i.e. small robots for domestic use
• CPC Class Codes: B25J 9/16 Programme controls programme controls in general G05B19/00, e.g. numerical pogramme controls G05B19/18; recording or playback systems G05B19/42
• CPC Class Codes: B25J 9/1661 characterised by task planning, object-oriented languages
• CPC Class Codes: B25J 9/1664 characterised by motion, path, trajectory planning
• CPC Class Codes: B25J 9/1697 Vision controlled systems
• CPC Class Codes: G05B 2219/40099 Graphical user interface for robotics, visual robot user interface
• CPC Class Codes: G05B 2219/40123 Indicate, select features on display, remote manipulator will execute
• CPC Class Codes: G05B 2219/40409 Robot brings object near operator, operator places object in correct position
• CPC Class Codes: G05B 2219/40411 Robot assists human in non-industrial environment like home or office
• CPC Class Codes: Y10S 901/01 Mobile robot

Abstract

A control system, a control method and a non-transitory computer readable storage medium cooperate to assist control for an autonomous robot. An interface receives recognition information from an autonomous robot (22), said recognition information including candidate target objects to interact with the autonomous robot (22). A display control unit (42) causes a display image to be displayed on a display of candidate target objects, wherein at least two of the candidate target objects are displayed with an associated indication of a target object score.

Claims

1. A control system for an autonomous robot, comprising:

an interface that receives recognition information from the autonomous robot, said recognition information including candidate target objects to interact with the autonomous robot; and

a display control unit that causes a display image to be displayed on a display of candidate target objects, wherein

the candidate target objects is displayed with an associated indication of a target object score.

2. The control system of claim 1, wherein

the display image includes an overhead space diagram of a room that includes a location of the autonomous robot and respective locations of the candidate target objects.

3. The control system of claim 1, further comprising:

the autonomous robot, wherein the autonomous robot includes in the recognition information the candidate target objects based on distance to the respective candidate target objects.

4. The control system of claim 1, further comprising

the autonomous robot, wherein the autonomous robot includes in the recognition information a score for respective of the candidate target objects.

5. The control system of claim 4, wherein the autonomous robot includes in the recognition information object images of the candidate target images arranged in order of score.

6. The control system of claim 2, further comprising:

the autonomous robot, wherein the autonomous robot includes in the recognition information space information regarding a space diagram of the room, and object images of the candidate target objects.

7. The control system of claim 1, further comprising:

a control unit that receives user input and generates a command to the autonomous robot that provides user feedback to the autonomous robot regarding user selection of one or more of the candidate target objects.

8. The control system of claim 7, further comprising:

the autonomous robot, wherein the autonomous robot is configured to identify non-target objects.

9. The control system of claim 7, further comprising:

the autonomous robot, wherein the autonomous robot is configured to identify a default selection of one or more of the candidate target objects.

10. The control system of claim 1, further comprising:

at least one of a tablet computer and a smartphone that includes said interface and display control unit.

11. The control system of claim 1, further comprising:

a scoring mechanism that identifies respective scores for said candidate target objects.

12. The control system of claim 1, wherein

the interface is configured to receive as input a category of a target object, and transmit an indication of said category of target object to the autonomous robot, and

the autonomous robot configured to identify within the scene one or more target objects in said category.

13. The control system of claim 1, further comprising:

the autonomous robot, wherein the autonomous robot assigns degree information for candidate target objects, the degree information being an indication of a likelihood of correct detection of respective target objects in said category.

14. The control system of claim 1, wherein

the interface is configured to receive voice or gesture input commands.

15. The control system of claim 11, further comprising:

a display that displays candidate target objects identified by the autonomous robot and user feedback sent via said communications interface to assist in controlling said autonomous robot.

16. A control method for an autonomous robot, comprising:

receiving through an interface recognition information from the autonomous robot, said recognition information including candidate target objects to interact with the autonomous robot; and

displaying a display image on a display of candidate target objects, wherein

at least two of the candidate target objects are displayed with an associated indication of a target object score.

17. The method of claim 16, wherein

the displaying includes displaying an overhead space diagram of a room that includes a location of the autonomous robot and respective locations of the candidate target objects.

18. The method of claim 16, further comprising:

receiving user input and generating a command to the autonomous robot that provides user feedback to the autonomous robot regarding user selection of one or more of the candidate target objects.

19. The method of claim 16, further comprising

receiving voice or gesture input commands.

20. A non-transitory computer readable storage medium having instructions stored therein that when executed by a processing circuit execute a control method for an autonomous robot, comprising:

receiving through an interface recognition information from the autonomous robot, said recognition information including candidate target objects to interact with the autonomous robot; and

displaying a display image on a display of candidate target objects, wherein

at least two of the candidate target objects are displayed with an associated indication of a target object score.