Image processing apparatus and method for adjusting intensity of a reflective property of an object in a displayed image

• US 10,373,344 B2
• Filed: 04/13/2015
• Issued: 08/06/2019
• Est. Priority Date: 04/23/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Morifuji, Takafumi, Tsutsumi, Tomonori
• Primary Examiner(s): McDowell, Jr., Maurice L.
• Application Number:
  US15/304,549
• Publication Number:
  US 20170039732A1
• Time in Patent Office: 1,576 Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 2219/2024 Style variation
• CPC Class Codes: H04N 1/407 Control or modification of tonal gradation or of extreme levels, e.g. background level

Abstract

The present disclosure relates to an image processing apparatus and method capable of reproducing texture as if objects are actually present. An operation environment information analysis unit acquires and analyzes user'"'"'s operation environment information for an image while the image is being displayed. The operation environment information analysis unit supplies the analyzed operation environment information as operation environment parameters to a property control unit. The property control unit causes an image combination unit to conduct texture control depending on visual environment parameters or operation environment parameters, thereby optimizing the texture control. The present disclosure is applicable to image processing apparatuses, for example.

Claims

1. An image processing apparatus, comprising:

one or more processors configured to;

acquire user operation information based on a user'"'"'s operation with respect to an image displayed on a display device;

acquire lighting information of an environment in which the image is displayed;

adjust intensity of a reflective property of an object in the displayed image; and

control a texture of the object in the displayed image based on the acquired user operation information, the acquired lighting information, and the adjusted intensity.

2. The image processing apparatus according to claim 1, wherein the user operation information is user'"'"'s operation information input for the displayed image.

3. The image processing apparatus according to claim 1, wherein the user operation information is user'"'"'s eyes information for the displayed image.

4. The image processing apparatus according to claim 1, wherein the user operation information is tilt information based on user'"'"'s movement of the display device that displays the image.

5. The image processing apparatus according to claim 1, wherein the user operation information is viewing information based on user'"'"'s viewing of the displayed image.

6. The image processing apparatus according to claim 1, wherein the one or more processors are further configured to change a viewpoint position of the object in the displayed image.

7. The image processing apparatus according to claim 1, wherein the one or more processors are further configured to change a geometry of the object in the displayed image.

8. The image processing apparatus according to claim 1, wherein the one or more processors are further configured to:

generate additional information; and

adjust, based on the additional information, a viewing environment,

wherein the displayed image is viewed based on control contents associated with the texture.

9. The image processing apparatus according to claim 8, wherein the one or more processors are further configured to adjust a viewing environment light based on the additional information.

10. The image processing apparatus according to claim 1, wherein the one or more processors are further configured to:

acquire physical property parameters of the object in the displayed image, and

control texture of the object in the displayed image based on the acquired physical property parameters.

11. The image processing apparatus according to claim 10, wherein the physical property parameters are reflective property information on the reflective property of the object.

12. The image processing apparatus according to claim 10, wherein the physical property parameters are information on materials of the object.

13. The image processing apparatus according to claim 10, wherein the physical property parameters are information on a geometry of the object.

14. The image processing apparatus according to claim 10, wherein the physical property parameters are information on lighting of the object.

15. An image processing method, comprising:

acquiring user operation information based on a user'"'"'s operation with respect to an image displayed on a display device;

acquiring lighting information of an environment in which the image is displayed;

adjusting intensity of a reflective property of an object in the displayed image; and

controlling a texture of the object in the displayed image based on the acquired user operation information, the acquired lighting information, and the adjusted intensity.