Article handling system and method and article management system and method

• US 7,209,803 B2
• Filed: 01/11/2006
• Issued: 04/24/2007
• Est. Priority Date: 02/17/2003
• Status: Active Grant

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Matsukawa, Yoshihiko, Sato, Satoshi, Yamada, Osamu, Okamoto, Shusaku, Naruoka, Tomonobu
• Primary Examiner(s): Black; Thomas
• Assistant Examiner(s): Marc; McDieunel
• Application Number:
  US11/330,381
• Publication Number:
  US 20060111812A1
• Time in Patent Office: 468 Days
• Field of Search: 700/245
• US Class Current: 700/245
• CPC Class Codes: B25J 5/007 mounted on wheels
• CPC Class Codes: B25J 9/0003 Home robots, i.e. small robots for domestic use
• CPC Class Codes: B25J 9/1697 Vision controlled systems
• CPC Class Codes: B65G 2203/041 Camera
• CPC Class Codes: G05B 2219/39387 Reflex control, follow movement, track face, work, hand, visual servoing
• CPC Class Codes: G05D 1/0251 extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593
• CPC Class Codes: G05D 1/0255 using acoustic signals, e.g. ultra-sonic singals sonar systems designed for anti-collision purposes G01S15/93
• CPC Class Codes: G05D 1/0274 using mapping information stored in a memory device navigation using map-matching G01C21/30

Abstract

A camera or other sensing unit senses the conditions of articles and mobile entities, including humans within a living space. An article management/operation server manages, within an article database, attribute information about the articles, including operators, according to the information from the sensing unit. The server receives a user'"'"'s instruction, input through a console unit, and refers to the article database to convert this instruction into a control command, which is then transmitted to a life-support robot.

Claims

1. An article transfer system, comprising:

a robot for transferring an article existing in a predetermined life space;

a console unit including a display section for displaying a console window and an input section which serves as an interface for a user, the console window including an article icon indicative of an article existing in the life space and a generic icon generically indicative of a plurality of locations in the life space;

an article database containing attribute information of the article; and

a controller for controlling the system,

wherein when the article icon and the generic icon are designated on the console window through the input section, the controller selects a location, from among a plurality of locations in the life space subordinate to the designated generic icon, according to the attribute information of the article corresponding to the designated article icon, the attribute information being retrieved from the article database, and the controller instructs the robot to transfer the article corresponding to the designated article icon to the selected location in the life space.

2. The article transfer system of claim 1, wherein:

the console unit has at least one console mode;

the article transfer system further includes a display controller for generating a console window which corresponds to the console mode;

the at least one console mode includes a virtual space console mode; and

the console window of the virtual space console mode includes a virtual space which simulates actual conditions of the life space and an article icon placed in the virtual space such that the article icon corresponds to an article existing in the life space.

3. The article transfer system of claim 2 wherein, in the virtual space console mode, an article icon and a location in the virtual space are designated on the console window, whereby an article that the robot is instructed to transfer and a location to which the article is transferred are designated.

4. The article transfer system of claim 1, wherein:

the console unit has at least one console mode;

the article transfer system further includes a display controller for generating a console window which corresponds to the console mode;

the at least one console mode includes an action icon console mode; and

the console window of the action icon console mode includes an article icon indicative of an article existing in the life space and an action icon indicative of an action exerted on the article.

5. The article transfer system of claim 4, wherein:

in the action icon console mode, an article icon and an action icon are designated on the console window, whereby an article handled by the robot and an action exerted on the article are designated; and

when an article icon and an action icon are designated on the console window, the controller selects a location in the life space according to an attribute of the designated article and the designated action, and the robot transfers the designated article to the selected location.

6. The article transfer system of claim 5, wherein the console window is configured such that an article icon is drag-and-droppable onto another icon.

7. The article transfer system of claim 6, wherein the console window is configured such that a plurality of article icons are drag-and-droppable at once onto another icon.

8. The article transfer system of claim 1, further comprising a sensor for detecting an article existing in a life space,

wherein the display controller generates a console window, the console window including an article icon which corresponds to an article detected by the sensor.

9. An article transfer system, comprising:

a robot for transferring an article existing in a predetermined life space;

a console unit including a display section for displaying a console window and an input section which serves as an interface for a user, the console window including an article icon indicative of an article existing in the life space and an action icon indicative of an action exerted on the article;

an article database containing attribute information of the article; and

a controller for controlling the system,

wherein when the article icon and the action icon are designated on the console window through the input section, the controller selects a location according to the attribute information of an article corresponding to the designated article icon and an action corresponding to the designated action icon, the attribute information being retrieved from the article database, and the controller instructs the robot to transfer the article corresponding to the designated article icon to the selected location in the life space.

10. The article transfer system of claim 9, further comprising a sensor for detecting an article existing in a life space,

wherein the display controller generates a console window, the console window including an article icon which corresponds to an article detected by the sensor.

11. A robot console unit for designating a task which is assigned to a robot for transferring an article existing in a predetermined life space, comprising:

a display section for displaying a console window which includes an article icon indicative of an article existing in the life space and a generic icon generically indicative of a plurality of locations in the life space;

an input section which serves as an interface for a user; and

a controller for controlling the console unit,

wherein when the article icon and the generic icon are designated on the console window through the input section, the controller selects a location, from among a plurality of locations in the life space subordinate to the designated generic icon, according to attribute information of the article corresponding to the designated article icon, the attribute information being retrieved from an article database, and the controller instructs the robot to transfer the article corresponding to the designated article icon to the selected location in the life space.

12. The robot console unit of claim 11, further comprising a display controller for generating a console window in the display section,

wherein the display controller displays on the display section a console window which includes a virtual space simulating actual conditions of the life space and an article icon placed in the virtual space such that the article icon corresponds to an article existing in the life space, and

the display controller includes a virtual space console mode where a task assigned to the robot is designated in the virtual space by a user through the input section.

13. The robot console unit of claim 11, further comprising a display controller for generating a console window in the display section,

wherein the display controller displays on the display section a console window which includes an article icon indicative of an article existing in the life space and an action icon indicative of an action exerted on the article,

the display controller includes an action icon console mode where a task assigned to the robot is designated on the console window by a user through the input section.

14. A robot console unit for designating a task which is assigned to a robot for transferring an article existing in a predetermined life space, comprising:

a display section for displaying a console window which includes an article icon indicative of an article existing in the life space and an action icon indicative of an action exerted on the article;

an input section which serves as an interface for a user; and

a controller for controlling the console unit,

wherein when the article icon and the action icon are designated on the console window through the input section, the controller selects a location in the life space according to attribute information of the article corresponding to the designated article icon and an action corresponding to the designated action icon, the attribute information being retrieved from an article database, and the controller instructs the robot to transfer the article corresponding to the designated article icon to the selected location in the life space.

15. An article transfer system, comprising:

a robot for transferring an article existing in a predetermined life space;

a console unit including a display section for displaying a console window and an input section which serves as an interface for a user, a task assigned to the robot being designated on the console window through the input section; and

a controller which includes a location icon console mode and an action icon console mode as console mode in the console unit,

wherein in the location icon console mode, a console window which includes an article icon indicative of an article existing in the life space and a location icon indicative of a specific location in the life space is displayed on the display section, and

in the action icon console mode, a console window which includes an article icon indicative of an article existing in the life space and an action icon indicative of an action exerted on the article is displayed on the display section,

when the article icon and the location icon displayed in the location icon console mode are designated, the controller instructs the robot to transfer an article corresponding to the designated article icon to a location corresponding to the designated location icon according to attribute information in the life space corresponding to the designated article icon and the location corresponding to the designated location icon, the attribute information being retrieved from an article database, and

when the article icon and the action icon displayed in the action icon console mode are designated, the controller selects a location in the life space according to attribute information of an article corresponding to the designated article icon and an action corresponding to the designated action icon and instructs the robot to transfer the article corresponding to the designated article icon to the selected location in the life space.

16. A robot console unit for designating a task which is assigned to a robot for transferring an article existing in a predetermined life space, comprising:

a display section for displaying a console window;

an input section which serves as an interface for a user;

a display controller for generating the console window in the display section; and

a transmitter for transmitting a control instruction to the robot,

wherein the display controller generates a location icon console mode where a console window includes an article icon indicative of an article existing in the life space and a location icon indicative of a specific location in the life space is displayed, and a task which is assigned to the robot is designated on the console window by a user through the input section,

the display controller generates an action icon console mode where a console window includes an article icon indicative of an article existing in the life space and an action icon indicative of an action exerted on the article, and a task which is assigned to the robot is designated on the console window by a user through the input section,

when the article icon and the location icon displayed in the location icon console mode are designated, the display controller transmits a control instruction to the robot to transfer an article corresponding to the designated article icon to a location corresponding to the designated location icon according to attribute information in the life space corresponding to the designated article icon and the location corresponding to the designated location icon, the attribute information being retrieved from an article database, and

when the article icon and the action icon displayed in the action icon console mode are designated, the display controller selects a location in the life space according to attribute information of an article corresponding to the designated article icon and an action corresponding to the designated action icon and transmits a control instruction to the robot to transfer the article corresponding to the designated article icon to the selected location in the life space, the attribute information being retrieved from the article database.