DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND PROGRAM

• US 20160239472A1
• Filed: 08/13/2014
• Published: 08/18/2016
• Est. Priority Date: 11/13/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: KASAHARA, Shunichi, REKIMOTO, Junichi
• Granted Patent: US 10,460,022 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

To be able to further facilitate interaction between users using AR technologies. Provided is a display control device including: a picture image acquiring unit configured to acquire a moving image corresponding to a sight of a first user in real time; a display control unit configured to display the moving image toward a second user different from the first user, and an annotation detection unit configured to detect that an annotation input by the second user with respect to the moving image is displayed in the sight of the first user or is output to be displayed. The display control unit further displays the displayed or output annotation toward the second user.

Claims

1. A display control device comprising:

a picture image acquiring unit configured to acquire a moving image corresponding to a sight of a first user in real time;

a display control unit configured to display the moving image toward a second user different from the first user, and

an annotation detection unit configured to detect that an annotation input by the second user with respect to the moving image is displayed in the sight of the first user or is output to be displayed,

wherein the display control unit further displays the displayed or output annotation toward the second user.

2. The display control device according to claim 1, wherein

the annotation detection unit further detects that the annotation is queued to be displayed or to be output, and

the display control unit displays the queued annotation toward the second user.

3. The display control device according to claim 2, wherein

the display control unit displays the displayed or output annotation and the queued annotation in forms that are different from each other.

4. The display control device according to claim 1, further comprising:

an annotation output control unit configured to output the annotation at a predetermined rate to display the annotation in the sight of the first user, and queue the annotation that is input over the predetermined rate.

5. The display control device according to claim 4, further comprising:

an output rate setting unit configured to set the predetermined rate on the basis of an operation performed by the first user or sensing information of the first user.

6. The display control device according to claim 5, wherein

the output rate setting unit sets the predetermined rate at 0 temporarily, on the basis of the sensing information of the first user.

7. The display control device according to claim 6, wherein

the display control unit further displays a notification indicating that the predetermined rate is 0, toward the second user.

8. The display control device according to claim 5, wherein

the output rate setting unit sets the predetermined rate at a maximum value until an amount of the queued annotation becomes less than a predetermined threshold value, on the basis of the operation performed by the first user.

9. The display control device according to claim 4, wherein

the annotation output control unit deletes at least a part of the queued annotation on the basis of an operation performed by the second user.

10. The display control device according to claim 1, wherein

the annotation detection unit further detects that the displayed or output annotation is gazed by the first user, and

the display control unit further displays a notification indicating that the displayed or output annotation is gazed, toward the second user.

11. The display control device according to claim 1, wherein

the display control unit displays the moving image into which the displayed or output annotation is integrated, toward the second user.

12. The display control device according to claim 11, wherein

the display control unit executes a process for integrating the displayed or output annotation into the moving image.

13. The display control device according to claim 11, wherein

the annotation detection unit is implemented by the picture image acquiring unit that acquires the moving image into which the displayed or output annotation is integrated.

14. A display control method comprising:

acquiring a moving image corresponding to a sight of a first user in real time;

displaying the moving image toward a second user different from the first user,

detecting, by a processor, that an annotation input by the second user with respect to the moving image is displayed in the sight of the first user or is output to be displayed; and

displaying the displayed or output annotation toward the second user.

15. A program for causing a computer to implement:

a function of acquiring a moving image corresponding to a sight of a first user in real time;

a function of displaying the moving image toward a second user different from the first user,

a function of detecting that an annotation input by the second user with respect to the moving image is displayed in the sight of the first user or is output to be displayed; and

a function of displaying the displayed or output annotation toward the second user.