DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND RECORDING MEDIUM

• US 20140292645A1
• Filed: 01/31/2014
• Published: 10/02/2014
• Est. Priority Date: 03/28/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: TSURUMI, Shingo
• Granted Patent: US 9,261,954 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

There is provided a display control device including a display controller configured to place a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part, and an operation acquisition part configured to acquire a user operation. When the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.

Claims

1. A display control device comprising:

a display controller configured to place a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part; and

an operation acquisition part configured to acquire a user operation,

wherein, when the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.

2. The display control device according to claim 1,

wherein, when the user operation is the first operation, the display controller causes the virtual object to move within the augmented reality space under a state where a relative position relationship between the imaging part and the virtual object is maintained.

3. The display control device according to claim 1,

wherein, when the user operation is the first operation, the display controller causes one or a plurality of virtual objects specified by the first operation to move within the augmented reality space.

4. The display control device according to claim 1,

wherein, while the display controller causes the virtual object to move within the augmented reality space, the display controller causes a fact that the virtual object is being moved to be displayed.

5. The display control device according to claim 1,

wherein, while the first operation is not being performed, the display controller fixes the virtual object within the augmented reality space.

6. The display control device according to claim 5,

wherein, while the first operation is not being performed, the display controller causes a size of the virtual object in the image to be changed in accordance with a distance between the imaging part and the virtual object.

7. The display control device according to claim 5,

wherein, while the first operation is not being performed, the display controller causes an attitude of the virtual object in the image to be changed in accordance with an attitude of the virtual object based on the imaging part.

8. The display control device according to claim 1,

wherein the display controller controls the virtual object on a basis of an environment of the virtual object at a destination.

9. The display control device according to claim 8,

wherein, when the environment of the virtual object at the destination is a movement-incapable region, the display controller causes a position of the virtual object to be shifted to a movement-capable region.

10. The display control device according to claim 1,

wherein the first operation includes an operation of specifying the virtual object using one or a plurality of operating objects.

11. The display control device according to claim 1,

wherein, when the user operation is a second operation, the display controller changes a size of the virtual object in the augmented reality space on a basis of the second operation.

12. The display control device according to claim 11,

wherein, when the size of the virtual object in the augmented reality space has reached a real size of the virtual object, the display controller stops enlarging the virtual object.

13. The display control device according to claim 11,

wherein, when the size of the virtual object in the augmented reality space has reached a real size of the virtual object, the display controller causes a fact that the size of the virtual object in the augmented reality space has reached the real size of the virtual object to be displayed.

14. The display control device according to claim 11,

wherein the display controller determines whether the size of the virtual object in the augmented reality space has reached a real size of the virtual object on a basis of known data related to a real size of the real object, a size of the real object in the image, and known data related to the real size of the virtual object.

15. The display control device according to claim 11,

wherein, when a selection operation is performed, the display controller selects a virtual object a size of which is to be changed on a basis of the selection operation.

16. The display control device according to claim 11,

wherein the display controller selects a virtual object a size of which is to be changed in accordance with distances from the imaging part and the respective one or plurality of virtual objects.

17. The display control device according to claim 11,

wherein the second operation includes an operation of making a distance between a plurality of operating objects larger.

18. The display control device according to claim 1,

wherein the display controller places the virtual object in a manner that the virtual object has an attitude corresponding to a gravity vector.

19. A display control method comprising:

placing a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part;

acquiring a user operation; and

causing the virtual object to move within the augmented reality space when the user operation is a first operation.

20. A non-transitory computer-readable recording medium having a program recorded thereon, the program being for causing a computer to function as a display control device including

a display controller configured to place a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part, and

an operation acquisition part configured to acquire a user operation,

wherein, when the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.