IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD

• US 20160307361A1
• Filed: 06/27/2016
• Published: 10/20/2016
• Est. Priority Date: 12/02/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: GOTO, HIROSHI, SHIONOZAKI, ATSUSHI, REKIMOTO, JUNICHI
• Granted Patent: US 10,540,805 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 15/503 Blending, e.g. for anti-aliasing
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person

Abstract

There is provided an image processing device including a depth acquisition unit configured to acquire depth information of an object included in a captured image, an image combining unit configured to combine the object with an image object having depth information according to each piece of the depth information, and an effect processing unit configured to execute effect processing according to the depth information of the object.

Claims

1. An image-processing system comprising

circuitry configured to:

acquire a first object image and a second object image, the first object image having first depth information and corresponding to a user in a real space, and the second object image having second depth information;

control display of a composite image of the first object image and the second object image, each of the first object image and the second object image being arranged in a virtual space;

control display of an effect image in the composite image in an event the first object image is apart from the second object image, the effect image including at least one of a first effect image and a second effect image, the first effect image extending from the first object image, and the second effect image including a message image;

acquire movement information of the user; and

adjust a position of the first object image in the composite image in accordance with the movement information.

2. The image-processing system according to claim 1, wherein the effect image includes the first effect image extending toward the second object image.

3. The image-processing system according to claim 2, wherein the first effect image has an arrow shape pointing at the second object image.

4. The image-processing system according to claim 2, wherein the effect image is added to the composite image in an event a distance between the first object image and the second object image is larger than a predetermined distance.

5. The image-processing system according to claim 1, wherein the effect image includes the second effect image indicating an alert.

6. The image-processing system according to claim 1, wherein the effect image includes the first effect image and the second effect image.

7. The image-processing system according to claim 1, wherein at least one of the first object image and the second object image is a human image.

8. The image-processing system according to claim 1, further comprising

an output device configured to display the composite image and the effect image, and

an input device configured to receive user'"'"'s input to control display of the output device.

9. The image-processing system according to claim 8, further comprising

a depth sensing device configured to detect the first depth information.

10. The image-processing system according to claim 9, wherein the input device includes a touch-control portion and a button.

11. The image-processing system according to claim 9, wherein the output device includes a headphone to output a sound.

12. The image-processing system according to claim 11, wherein the input device includes a button and a lever configured to receive the user'"'"'s input.

13. The image-processing system according to claim 11, wherein the output device includes a lump.

14. The image-processing system according to claim 9, wherein the output device includes a speaker to output a sound.

15. An image-processing method comprising:

controlling a display to display a composite image in which a first object image and a second-object image are arranged in a virtual space, the first object image having first depth information and corresponding to a user in a real space, and the second object image having second depth information;

controlling display of an effect image to the composite image in an event the first object image is apart from the second object image, the effect image including at least one of a first effect image and a second effect image, the first effect image extending from the first object image, and the second effect image including a message image;

acquiring movement information of the user from a depth sensing device; and

controlling the display to adjust a position of the first object image in the composite image in accordance with the movement information.

16. A non-transitory computer readable medium having stored thereon, a set of computer-executable instructions for causing a computer to perform operations comprising:

controlling a display to display a composite image in which a first object image and a second-object image are arranged in a virtual space, the first object image having first depth information and corresponding to a user in a real space, and the second object image having second depth information;

controlling display of an effect image to the composite image in an event the first object image is apart from the second object image, the effect image including at least one of a first effect image and a second effect image, the first effect image extending from the first object image, and the second effect image including a message image;

acquiring movement information of the user from a depth sensing device; and

controlling the display to adjust a position of the first object image in the composite image in accordance with the movement information.