DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND PROGRAM

• US 20160055676A1
• Filed: 03/10/2014
• Published: 02/25/2016
• Est. Priority Date: 04/04/2013
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: KASAHARA, Shunichi, REKIMOTO, Junichi
• Application Number:
  US14/779,789
• Publication Number:
  US 20160055676A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/004 Annotating, labelling

Abstract

Provided is a display control device including: a display control unit configured to control a display unit of a terminal device. The display control unit performs control to decide a display position of a virtual object displayed in a real space via the display unit based on positional information associated with the virtual object in the real space and display the virtual object in the real space based on the display position, and control to display a notification indicating presence of the virtual object in the real space when a part or all of the virtual object is outside of a visible range of the real space.

Claims

1. A display control device comprising:

a display control unit configured to control a display unit of a terminal device,

wherein the display control unit performs

control to decide a display position of a virtual object displayed in a real space via the display unit based on positional information associated with the virtual object in the real space and display the virtual object in the real space based on the display position, and

control to display a notification indicating presence of the virtual object in the real space when a part or all of the virtual object is outside of a visible range of the real space.

2. The display control device according to claim 1, wherein the display control unit displays the notification when all of the virtual object is outside of the visible range.

3. The display control device according to claim 2, wherein the notification includes an indication denoting a direction toward the virtual object in a view from the visible range.

4. The display control device according to claim 3, wherein the notification is displayed in a marginal portion of the visible range corresponding to the direction.

5. The display control device according to claim 3, wherein the notification includes an indication denoting a distance between the visible range and the virtual object.

6. The display control device according to claim 3, wherein the notification includes display of a shadow of the virtual object when the direction toward the virtual object in the view from the visible range corresponds to a light source direction in the real space.

7. The display control device according to claim 6, wherein the display control unit continues the display of the shadow even after the virtual object enters the visible range.

8. The display control device according to claim 2, further comprising:

an image acquisition unit configured to acquire a captured image of the real space,

wherein the notification includes an image of the real space at a position corresponding to the positional information extracted from the captured image.

9. The display control device according to claim 8, wherein the notification includes an image in which the virtual object is superimposed on the image of the real space at a position corresponding to the positional information extracted from the captured image previously acquired.

10. The display control device according to claim 2, wherein the notification includes navigation for moving the display unit in a manner that a position corresponding to the positional information associated with the previous virtual object enters the visible range.

11. The display control device according to claim 1, wherein the display control unit displays the notification when the part of the virtual object is outside of the visible range.

12. The display control device according to claim 11, wherein the notification includes an indication denoting a size or a proportion of an invisible portion of the virtual object, the invisible portion being outside of the visible range.

13. The display control device according to claim 12, wherein the indication denoting the size or the proportion of the invisible portion is a region in which the virtual object is disposed in a portion in contact with a marginal portion of the visible range, and the size or the proportion of the invisible portion is indicated by a size of the region.

14. The display control device according to claim 1,

wherein the virtual object includes information regarding a real object at a position corresponding to the positional information, and

wherein the display control unit continues to display the notification while suppressing display of the virtual object until the real object is disposed at a predetermined position in the display unit.

15. The display control device according to claim 1, wherein the visible range is defined in accordance with a range of an image of the real space displayed on the display unit.

16. The display control device according to claim 15, further comprising:

an image acquisition unit configured to acquire a captured image of the real space,

wherein the display control unit causes the display unit to display a part of the captured image as the image of the real space.

17. The display control device according to claim 1, wherein the visible range is defined in accordance with a range in which an image is able to be displayed additionally in the real space by the display unit.

18. The display control device according to claim 1, wherein the display control unit performs control to cause the notification to be displayed in a device where an input of the virtual object is performed, the device being different from the terminal device.

19. A display control method comprising, by a processor configured to control a display unit of a terminal device:

deciding a display position of a virtual object displayed in a real space via the display unit based on positional information associated with the virtual object in the real space and displaying the virtual object in the real space based on the display position; and

displaying a notification indicating presence of the virtual object in the real space when a part or all of the virtual object is outside of a visible range of the real space.

20. A program causing a computer configured to control a display unit of a terminal device to realize:

a function of deciding a display position of a virtual object displayed in a real space via the display unit based on positional information associated with the virtual object in the real space and displaying the virtual object in the real space based on the display position; and

a function of displaying a notification indicating presence of the virtual object in the real space when a part or all of the virtual object is outside of a visible range of the real space.