IMAGE PROCESSING APPARATUS AND METHOD

• US 20170039732A1
• Filed: 04/13/2015
• Published: 02/09/2017
• Est. Priority Date: 04/23/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: TSUTSUMI, TOMONORI, MORIFUJI, TAKAFUMI
• Granted Patent: US 10,373,344 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 2219/2024 Style variation
• CPC Class Codes: H04N 1/407 Control or modification of tonal gradation or of extreme levels, e.g. background level

Abstract

The present disclosure relates to an image processing apparatus and method capable of reproducing texture as if objects are actually present. An operation environment information analysis unit acquires and analyzes user'"'"'s operation environment information for an image while the image is being displayed. The operation environment information analysis unit supplies the analyzed operation environment information as operation environment parameters to a property control unit. The property control unit causes an image combination unit to conduct texture control depending on visual environment parameters or operation environment parameters, thereby optimizing the texture control. The present disclosure is applicable to image processing apparatuses, for example.

Claims

1. An image processing apparatus comprising:

a user operation information acquisition unit for acquiring user operation information on user'"'"'s operations performed while an image is being displayed; and

a texture control unit for controlling texture of an object in the image depending on the user operation information acquired by the user operation information acquisition unit.

2. The image processing apparatus according to claim 1,

wherein the user operation information is user'"'"'s operation information input for a displayed image.

3. The image processing apparatus according to claim 1,

wherein the user operation information is user'"'"'s eyes information for a displayed image.

4. The image processing apparatus according to claim 1,

wherein the user operation information is tilt information when the user moves a display displaying the image thereon.

5. The image processing apparatus according to claim 1,

wherein the user operation information is viewing information on viewing of the user viewing a displayed image.

6. The image processing apparatus according to claim 1,

wherein the texture control unit adjusts intensity of a reflective property of the object in the image.

7. The image processing apparatus according to claim 1,

wherein the texture control unit changes a viewpoint position of the object in the image.

8. The image processing apparatus according to claim 1,

wherein the texture control unit changes a geometry of the object in the image.

9. The image processing apparatus according to claim 1, further comprising:

an additional information generation unit for generating additional information for adjusting a viewing environment in which a displayed image is viewed depending on control contents of the texture control unit.

10. The image processing apparatus according to claim 9,

wherein the additional information is directed for adjusting a viewing environment light.

11. The image processing apparatus according to claim 1, further comprising:

a physical property parameter acquisition unit for acquiring physical property parameters of an object in an image,

wherein the texture control unit controls texture of the object in the image depending on the physical property parameters acquired by the physical property parameter acquisition unit.

12. The image processing apparatus according to claim 11,

wherein the physical property parameters are reflective property information on a reflective property of the object.

13. The image processing apparatus according to claim 11,

wherein the physical property parameters are information on materials of the object.

14. The image processing apparatus according to claim 11,

wherein the physical property parameters are information on a geometry of the object.

15. The image processing apparatus according to claim 11,

wherein the physical property parameters are information on lighting of the object.

16. An image processing method in which an image processing apparatus acquires user operation information on user'"'"'s operations performed while an image is being displayed, and

controls texture of an object in the image depending on the acquired user operation information.