Display control device, display control method, and recording medium

• US 9,261,954 B2
• Filed: 01/31/2014
• Issued: 02/16/2016
• Est. Priority Date: 03/28/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tsurumi, Shingo
• Primary Examiner(s): SHENG, TOM V
• Application Number:
  US14/169,474
• Publication Number:
  US 20140292645A1
• Time in Patent Office: 746 Days
• Field of Search: 345/633, 345/173, 382/312
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

There is provided a display control device including a display controller configured to place a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part, and an operation acquisition part configured to acquire a user operation. When the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.

Claims

1. A display control device comprising:

a display controller configured to place a virtual object within an augmented reality space, corresponding to a real space, in accordance with a recognition result of a real object shown in a two-dimensional image captured by an imaging part; and

an operation acquisition part configured to acquire a user operation,

wherein, when the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.

2. The display control device according to claim 1, wherein, when the user operation is the first operation, the display controller causes the virtual object to move within the augmented reality space under a state where a relative position relationship between the imaging part and the virtual object is maintained.

3. The display control device according to claim 1, wherein, when the user operation is the first operation, the display controller causes one or more of a plurality of virtual objects specified by the first operation to move within the augmented reality space.

4. The display control device according to claim 1, wherein, while the display controller causes the virtual object to move within the augmented reality space, the display controller displays a message indicating that the virtual object is being moved.

5. The display control device according to claim 1, wherein, while the first operation is not being performed, the display controller fixes the virtual object within the augmented reality space.

6. The display control device according to claim 5, wherein the display controller is configured to change a size of the virtual object in the two-dimensional image in accordance with a distance between the imaging part and the virtual object in a state in which the virtual object is fixed within the augmented reality space.

7. The display control device according to claim 5, wherein the display controller is configured to change an attitude of the virtual object in the two-dimensional image in accordance with an attitude of the virtual object based on the imaging part.

8. The display control device according to claim 1, further comprising an environment recognition part for recognizing an environment of the virtual object at a destination,

wherein the display controller is configured to control the virtual object based on the recognized environment of the virtual object at the destination.

9. The display control device according to claim 8, wherein the display controller is configured to shift a position of the virtual object to a movement-capable region in a state in which the recognized environment of the virtual object at the destination is a movement-incapable region.

10. The display control device according to claim 1, wherein the first operation includes an operation of specifying the virtual object using one or more of a plurality of operating objects.

11. The display control device according to claim 1, wherein, in a state in which the user operation is a second operation, the display controller is configured to change a size of the virtual object in the augmented reality space based on the second operation.

12. The display control device according to claim 11, wherein, in a state in which the size of the virtual object in the augmented reality space has reached a real size of the virtual object, the display controller is configured to stop enlarging the virtual object.

13. The display control device according to claim 11, wherein, in a state in which the size of the virtual object in the augmented reality space has reached a real size of the virtual object, the display controller is configured to display a message indicating that the size of the virtual object in the augmented reality space has reached the real size of the virtual object.

14. The display control device according to claim 11, wherein the display controller is configured to determine whether the size of the virtual object in the augmented reality space has reached a real size of the virtual object based on known data related to a real size of the real object, a size of the real object in the two-dimensional image, and known data related to the real size of the virtual object.

15. The display control device according to claim 11, wherein the display controller is configured to select another virtual object, a size of which is to be changed, based on a selection operation.

16. The display control device according to claim 11, wherein the display controller is configured to select another virtual object, a size of which is to be changed, in accordance with distances from the imaging part and each of one or more of virtual objects.

17. The display control device according to claim 11, wherein the second operation includes an operation of increasing a distance between a plurality of operating objects.

18. The display control device according to claim 1, wherein the display controller is configured to place the virtual object in a manner that the virtual object has an attitude corresponding to a gravity vector.

19. A display control method comprising:

placing a virtual object within an augmented reality space, corresponding to a real space, in accordance with a recognition result of a real object shown in a two-dimensional image captured by an imaging part;

acquiring a user operation; and

causing the virtual object to move within the augmented reality space when the user operation is a first operation.

20. A non-transitory computer-readable storage medium having stored thereon, a set of computer-readable instructions, for causing a computer to perform steps comprising:

placing a virtual object within an augmented reality space, corresponding to a real space, in accordance with a recognition result of a real object shown in a two-dimensional image captured by an imaging part; and

acquiring a user operation,

wherein, when the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.