IMAGE PROCESSING DEVICE AND METHOD

• US 20160381348A1
• Filed: 09/02/2014
• Published: 12/29/2016
• Est. Priority Date: 09/11/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Hayasaka, Kengo, Mori, Hironori, Ito, Katsuhisa
• Granted Patent: US 10,587,864 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 30/0635 Processing of requisition or of purchase orders
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04N 13/133 Equalising the characteristics of different image components, e.g. their average brightness or colour balance
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/178 Metadata, e.g. disparity information
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

An image processing apparatus including circuitry configured to initiate a setting of an object for display within a background image in accordance with a modeling condition associated with a position at which the object is set, based on depth data and base-line length information associated with the background image and modeling data of the object.

Claims

1. An image processing apparatus, comprising:

circuitry configured to initiate a setting of an object for display within a background image in accordance with a modeling condition associated with a position at which the object is set, based on depth data and base-line length information associated with the background image and modeling data of the object.

2. The image processing apparatus according to claim 1, wherein the circuitry is further configured to initiate a changing of a condition of the object to a condition corresponding to a second position, based on a change of position at which the object is set from a first position to the second position.

3. The image processing apparatus according to claim 1, wherein the circuitry is further configured to initiate a changing of a condition of the object from a condition associated with a first viewpoint to a condition associated with a second view point, based on a changing of a viewpoint of the background image from the first viewpoint to the second viewpoint.

4. The image processing apparatus according to claim 1, wherein the circuitry is further configured to initiate a changing of a condition of the object from a condition associated with a first viewing direction to a condition associated with a second viewing direction, based on a changing of a direction of a viewpoint of the background image from the first viewing direction to the second viewing direction.

5. The image processing apparatus according to claim 1, wherein the circuitry is further configured to initiate a moving of the object, and repositioning of the object to have a condition of making contact with a plane of the background image.

6. The image processing apparatus according to claim 5, wherein the condition of making contact with the plane is determined based on a distance between the object and the plane.

7. The image processing apparatus according to claim 1, wherein a condition of the object is a condition associated with a position and an orientation of the object.

8. The image processing apparatus according to claim 1, wherein the circuitry is further configured to initiate a simulation of a lighting in the background image based on light source parameters and the depth data, the light source parameters being parameters related to a light source.

9. The image processing apparatus according to claim 1, wherein the circuitry is further configured to initiate an identification of a portion that satisfies line-of-flow conditions in the background image having the object placed therein, and initiates an emphasizing of the identified portion.

10. The image processing apparatus according to claim 1, wherein the circuitry is further configured to initiate a setting of an image of a person within the background image, in accordance with a modeling condition associated with a position at which the image of the person is set within the background image having the object placed therein, and based on the depth data, the base-line length information, and modeling data of the image of the person.

11. The image processing apparatus according to claim 1, wherein the object is selected from among one or more candidate objects, in accordance with a modeling condition of the selected object associated with a position at which the selected object is set in the background image, and based on the depth data, the base-line length information, and the modeling data of the selected object.

12. The image processing apparatus according to claim 11, wherein the one or more candidate objects are objects that can be placed within the background image.

13. The image processing apparatus according to claim 1, wherein the circuitry is further configured to initiate a control of a capturing of an image of a subject, initiate an obtaining of the captured image as the background image, and initiate a generation of depth data of the captured image.

14. The image processing apparatus according to claim 13, wherein

the captured image is a multiview image formed with a plurality of images having different viewpoints from one another, and

the circuitry is further configured to initiate a generation of depth data of the multiview image, and to initiate a generation of a virtual captured image as the background image based on the multiview image and the depth data, the virtual captured image being obtained by imaging a subject of the multiview image.

15. The image processing apparatus according to claim 1, wherein the object is an image of furniture.

16. The image processing apparatus according to claim 15, wherein the circuitry is further configured to initiate a performing of a purchase process to purchase the furniture that is placed within the background image.

17. The image processing apparatus according to claim 1, wherein the circuitry is further configured to initiate a transmission of multiview image data as data of a multiview image and depth data of the multiview image, the multiview image being formed with a plurality of images having different viewpoints from one another and used for generating the background image.

18. The image processing apparatus according to claim 17, wherein the circuitry is further configured to initiate a generation of image data of the background image having the object set therein, and initiate a transmission of the generated image data.

19. The image processing apparatus according to claim 17, wherein the circuitry is further configured to initiate a generation of an application parameter that is a parameter related to a combining of the background image and the object, and initiate a transmission of the generated application parameter.

20. The image processing apparatus according to claim 17, wherein the circuitry is further configured to initiate a generation of metadata about the multiview image, and initiate a transmission of the generated metadata.

21. The image processing apparatus according to claim 19, wherein the metadata includes the base-line length information.

22. The image processing apparatus according to claim 1, wherein the depth data indicates a distance of depth direction in the background image, and the base-line length information indicates a reference length associated with the background image.

23. An image processing method comprising:

setting an object for display within a background image in accordance with a modeling condition associated with a position at which the object is set, based on depth data and base-line length information associated with the background image and modeling data of the object; and

placing the set object to be displayed at the position within the background image.