ROBOT SYSTEM HAVING AUGMENTED REALITY-COMPATIBLE DISPLAY

• US 20160158937A1
• Filed: 11/11/2015
• Published: 06/09/2016
• Est. Priority Date: 12/08/2014
• Status: Active Grant

• Current Assignee: Fanuc Corporation
• Original Assignee: Fanuc Corporation
• Inventors: KAMOI, Toshiaki, Inaba, Gou
• Granted Patent: US 10,052,765 B2
• Time in Patent Office: Days
• CPC Class Codes: B25J 9/1605 Simulation of manipulator lay-out, design, modelling of manipulator
• CPC Class Codes: B25J 9/1628 characterised by the control loop
• CPC Class Codes: B25J 9/1671 characterised by simulation, either to verify existing program or to create and verify new program, CAD/CAM oriented, graphic oriented programming systems
• CPC Class Codes: B25J 9/1697 Vision controlled systems
• CPC Class Codes: G05B 2219/39451 Augmented reality for robot programming
• CPC Class Codes: Y10S 901/05 Machine driven lead through

Abstract

A robot system using an augmented reality-compatible display, capable of providing information on the status and/or an operation guide of a robot added to an actual image or actual environment, to a user of the robot, so as to improve the efficiency of operations carried out by the user. The robot system includes an actual robot, a controller which controls the actual robot, and an image capturing-displaying device connected to the controller by a wire or by radio. The image capturing-displaying device has a function for capturing an image of a scene including the actual robot and a function for displaying the captured image in real-time. The user can obtain a scene including the actual robot in real-time by directing a camera arranged on the image capturing-displaying device toward the actual robot, and can monitor an augmented reality image.

Claims

1. A robot system comprising:

a robot;

a controller which controls the robot;

an image capturing-displaying device connected to the controller, and having a function for capturing an image of a scene including the robot and a function for displaying the image in real-time; and

a measuring part which measures relative position and angle between the robot and the image capturing-displaying device, based on the image displayed in real-time on the image capturing-displaying device,

wherein the image capturing-displaying device has a display on which additional information representing a status or an operation guide of the robot is overlapped with the image displayed on the image capturing-displaying device in real-time, based on the relative position and angle measured by the measuring part.

2. The robot system as set forth in claim 1, wherein the image capturing-displaying device has a display for displaying a video image of an actual scene, and the additional information is overlapped with an actual image of the robot included in the video image.

3. The robot system as set forth in claim 1, wherein the image capturing-displaying device has a display for displaying a transmissive image of an actual scene, and the additional information is overlapped with an actual image of the robot of the transmissive image.

4. The robot system as set forth in claim 1, wherein the image capturing-displaying device is a teaching pendant connected to the controller.

5. The robot system as set forth in claim 1, wherein the additional information is an image representing a direction in which the robot is capable of being moved by manual operation.

6. The robot system as set forth in claim 1, wherein the additional information is a luminescent image, a luminescence intensity of which corresponds to a present value of a velocity override of the robot.

7. The robot system as set forth in claim 1, wherein the additional information is a luminescent image of an apparatus in which an abnormality is detected.