IMAGE PROCESSING DEVICE, AND COMPUTER PROGRAM PRODUCT

• US 20140313228A1
• Filed: 01/29/2013
• Published: 10/23/2014
• Est. Priority Date: 02/10/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kasahara, Shunichi
• Granted Patent: US 9,639,988 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

An information processing apparatus and non-transitory computer readable medium cooperate to provide a control unit having circuitry configured to receive an indication of a detected posture of the information processing apparatus, and attach a virtual object to a reference environment with a posture related to the detected posture of the information processing apparatus.

Claims

1. An information processing apparatus comprising:

a control unit having circuitry configured to

receive an indication of a detected posture of the information processing apparatus, and

attach a virtual object to a reference environment with a posture related to the detected posture of the information processing apparatus.

2. The information processing apparatus of claim 1, further comprising:

a display control unit configured to change display attributes of the virtual object according to a distance from the virtual object to the image processing apparatus.

3. The information processing apparatus of claim 2, wherein

the display control unit emphasizes a display attribute to a greater extent when the distance is shorter than a predetermined longer distance.

4. The information processing apparatus of claim 1, further comprising:

a display control unit that rearranges a display of the virtual object with another virtual object so a predetermined display space is set therebetween, said display control unit rearranges the display in response to a predetermined condition being satisfied.

5. The information processing apparatus of claim 1, further comprising:

an object arrangement unit that is configured to sequentially store object arrangement matrices of the virtual object for a plurality of images with respect to the reference environment.

6. The information processing apparatus of claim 5, wherein

the control unit generates a track of the virtual object or an animation of the virtual object as moving along a track of the image processing device when moving.

7. The information processing apparatus of claim 1, further comprising:

a communications interface that provides information of the virtual object in association with the reference environment to an object management unit that registers the information of the virtual object.

8. The information processing apparatus of claim 7, wherein

said communications interface sends said information to the object management unit that is implemented as a cloud resource at a remote location.

9. The information processing apparatus of claim 7, wherein

said information of the virtual object is available for retrieval with another information processing apparatus so the another information processing apparatus can share the virtual object and display the virtual object when the another information processing apparatus views the reference environment in with the virtual object is attached.

10. The information processing apparatus of claim 1, further comprising:

a display controller that causes a user ID to be displayed in association with another information processing device within the reference environment.

11. The information processing apparatus of claim 1, further comprising:

a display controller that causes a user ID of another information processing device that is not currently present in the reference environment to be displayed in association with the reference environment.

12. The information processing apparatus of claim 11, wherein

the another information processing device was located in the reference environment in the past or remotely viewing the reference environment from a location outside the reference environment.

13. The information processing apparatus of claim 11, further comprising

a communications interface through which social media communications with a user associated with the user ID is shared.

14. The information processing apparatus of claim 1, further comprising

a user interface having a touch operation that is configured to trigger the control unit to attach the virtual object in response to the touch operation.

15. The information processing apparatus of claim 1, further comprising:

a recognition unit that detects the detected posture based on image recognition, said detected posture being based on a reference plane that is part of a real object.

16. The information processing apparatus of claim 1, wherein

the control unit arranges the virtual object so the virtual object is overlaid on a position and attitude of the information processing apparatus at a predetermined position.

17. The information processing apparatus of claim 1, further comprising

a display screen;

and

an object arrangement unit that arranges the virtual object at a position offset in a direction along the display screen according to a user specified input position on the display screen.

18. An information processing apparatus comprising:

a communication interface that

receives from a remote device an indication of a detected posture of the remote device and a virtual object provided by the remote device; and

circuitry configured to attach the virtual object to a reference environment of the remote device with a posture related to the detected posture of the remote device.

19. A non-transitory computer readable medium having computer readable instructions that when executed by processing circuitry performs a method, said method comprising:

receiving an indication of a detected posture of an information processing apparatus; and

attaching a virtual object to a reference environment with a posture related to the detected posture of the information processing apparatus.

20. A non-transitory computer readable medium having computer readable instructions that when executed by processing circuitry performs a method, said method comprising:

receiving from a remote device an indication of a detected posture of the remote device and a virtual object provided by the remote device; and

attaching with circuitry the virtual object to a reference environment of the remote device with a posture related to the detected posture of the remote device.