Information processing device, information processing method, and program

• US 8,854,393 B2
• Filed: 03/09/2011
• Issued: 10/07/2014
• Est. Priority Date: 03/17/2010
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ishige, Hiroyuki, Suzuki, Kazuhiro, Miyashita, Akira
• Primary Examiner(s): HARRISON, CHANTE E
• Application Number:
  US13/043,772
• Publication Number:
  US 20110227945A1
• Time in Patent Office: 1,308 Days
• Field of Search: 345/619, 345632-633, 345/169, 345/158, 345/8, 345/1.1, 345/419, 345/156, 345/649, 345/651, 345/653, 463/31, 386/224, 715/863
• US Class Current: 345/619
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

There is provided an information processing device includes a virtual space recognition unit for analyzing 3D space structure of a real space to recognize a virtual space, a storage unit for storing an object to be arranged in the virtual space, a display unit for making a display unit display the object arranged in the virtual space, a direction of gravitational force detection unit for detecting a direction of gravitational force of a real space, and a direction of gravitational force reflection unit for reflecting the direction of gravitational force detected by the detection unit in the virtual space.

Claims

1. An information processing device comprising:

circuitry configured to;

analyze 3D space structure of a real space of an image of the real space to recognize a virtual space of the image;

store an object to be arranged in the virtual space;

make a display device display the object arranged in the virtual space;

detect a direction of gravitational force of the real space;

reflect the detected direction of gravitational force in the virtual space such that the object is displayed on the display device vertically in the direction of gravitational force regardless of a position of the display device;

execute predetermined processing based on the direction of gravitational force to the object in the virtual space in which the direction of gravitational force is reflected; and

recognize a plane which exists in a direction of gravitational force in the virtual space, wherein

the direction of gravitational force in the virtual space is determined based upon the direction of gravitational force in the real space.

2. The information processing device according to claim 1, wherein the circuitry is configured to:

detect a change of the direction of gravitational force to the display device, and

reflect the change of the direction of gravitational force in the virtual space.

3. The information processing device according to claim 1,

wherein the circuitry is configured to detect position information of the display device in the virtual space.

4. The information processing device according to claim 3,

wherein the circuitry is configured to arrange the object based on the position information of the display device, and move the object in the direction of gravitational force.

5. The information processing device according to claim 3,

wherein the circuitry is configured to arrange the object based on the position information of the display device, and move a posture of the object in the direction of gravitational force.

6. The information processing device according to claim 3,

wherein the circuitry is configured to arrange the object based on the position information of the display device, and make the object arranged vertically in the direction of gravitational force.

7. The information processing device according to claim 1,

wherein the circuitry is configured to detect the direction of gravitational force using an acceleration sensor.

8. The information processing device according to claim 1, wherein the circuitry is configured to recognize at least one of a position, a posture, a size, and a position of the information processing apparatus in the virtual space.

9. The information processing device according to claim 1, wherein the circuitry includes at least one of a geomagnetic compass, an acceleration sensor, and a GPS device.

10. The information processing device according to claim 1, wherein the circuitry is configured to superimpose a space coordinate system of the virtual space of the image on a space coordinate system of the real space of the image.

11. The information processing device according claim 1, wherein the circuitry is configured to arrange the object, which has been moved in the direction of gravitational force, on the plane.

12. The information processing device according to claim 11, wherein the circuitry is configured to cause the display device to display the object falling on the plane in the direction of gravitational force.

13. The information processing device according to claim 11, wherein the circuitry is configured to cause the display device to display the object as hitting the plane and falling in a direction of the plane.

14. The information processing device according to claim 1, wherein the circuitry is configured to recognize all of a position, a posture, a size, and a position of the information processing apparatus in the virtual space.

15. An information processing method comprising the steps of:

analyzing 3D space structure of a real space of an image of the real space to recognize a virtual space of the image;

arranging an object in the virtual space;

detecting a direction of gravitational force of the real space;

reflecting the direction of gravitational force in the virtual space;

making a display device display the object arranged in the virtual space such that the object is displayed on the display device vertically in the direction of gravitational force regardless of a position of the display device

executing predetermined processing based on the direction of gravitational force to the object in the virtual space in which the direction of gravitational force is reflected; and

recognizing a plane which exists in a direction of gravitational force in the virtual space, wherein

the direction of gravitational force in the virtual space is determined based upon the direction of gravitational force in the real space.

16. A non-transitory computer readable medium storing a program causing which, when executed, causes a computer to function as an information processing device comprising:

a virtual space recognition unit for analyzing 3D space structure of a real space of an image of the real space to recognize a virtual space of the image;

a storage unit for storing an object to be arranged in the virtual space;

a display unit for making a display device display the object arranged in the virtual space;

a detection unit for detecting a direction of gravitational force of a real space;

a direction of gravitational force reflection unit for reflecting the direction of gravitational force detected by the detection unit in the virtual space such that the object is displayed on the display device vertically in the direction of gravitational force regardless of a position of the display device; and

an execution unit for executing predetermined processing based on the direction of gravitational force to the object in the virtual space in which the direction of gravitational force is reflected by the direction of gravitational force reflection unit, wherein

the execution unit recognizes a plane which exists in a direction of gravitational force in the virtual space, and

the direction of gravitational force in the virtual space is determined based upon the direction of gravitational force in the real space.