IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM

• US 20170352290A1
• Filed: 10/09/2015
• Published: 12/07/2017
• Est. Priority Date: 01/15/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: SASAKI, TOSHIYUKI, NAGANO, TAKAHIRO, YOKOKAWA, MASATOSHI, NAGUMO, TAKEFUMI
• Granted Patent: US 10,726,740 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/015 By temperature mapping of body part
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A61B 5/7455 characterised by tactile indication, e.g. vibration or electrical stimulation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 7/13 Edge detection
• CPC Class Codes: G06T 7/40 Analysis of texture depth or shape recovery from texture G06T7/529
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G09B 21/003 using tactile presentation of the information, e.g. Braille displays
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

To make it possible to reduce a human load for a cutaneous sensation control setting corresponding to an image. Provided is an image processing device including: an infrared image acquisition unit that acquires an infrared image of an imaged object; a visible light image acquisition unit that acquires a visible light image of the imaged object; a generation unit that generates cutaneous sensation control parameters on the basis of the infrared image acquired by the infrared image acquisition unit; and a data processing unit that associates the visible light image acquired by the visible light image acquisition unit with the cutaneous sensation control parameters generated by the generation unit.

Claims

1. An image processing device comprising:

an infrared image acquisition unit that acquires an infrared image of an imaged object;

a visible light image acquisition unit that acquires a visible light image of the imaged object;

a generation unit that generates cutaneous sensation control parameters on the basis of the infrared image acquired by the infrared image acquisition unit; and

a data processing unit that associates the visible light image acquired by the visible light image acquisition unit with the cutaneous sensation control parameters generated by the generation unit.

2. The image processing device according to claim 1,

wherein the generation unit generates the cutaneous sensation control parameters for each pixel region of the infrared image, and

the data processing unit performs the association by assigning the cutaneous sensation control parameters to pixels of the visible light image that correspond to each pixel region of the infrared image.

3. The image processing device according to claim 2,

wherein the cutaneous sensation control parameters include tactile sensation control parameters, and

the generation unit generates the tactile sensation control parameters on the basis of pixel values of the infrared image acquired by the infrared image acquisition unit.

4. The image processing device according to claim 3,

wherein the infrared image acquisition unit acquires infrared images at a plurality of infrared ray irradiation angles with respect to the imaged object, and

the generation unit generates the tactile sensation control parameters on the basis of the plurality of infrared images acquired by the infrared image acquisition unit.

5. The image processing device according to claim 4,

wherein the tactile sensation control parameters include a parameter for controlling a tactile sensation corresponding to a surface roughness of an object and a parameter for controlling a tactile sensation corresponding to a density of texture boundaries on a surface of the object.

6. The image processing device according to claim 5,

wherein the generation unit generates the parameter for controlling a tactile sensation corresponding to the surface roughness of the object by estimating a surface roughness of the object in the pixel region on the basis of a distribution of pixel values corresponding to the pixel region at the plurality of infrared ray irradiation angles, and generates the parameter for controlling a tactile sensation corresponding to the density of the texture boundaries on the surface of the object by estimating the density of the texture boundaries on the surface of the object on the basis of a dispersion of estimated surface roughnesses of the object.

7. The image processing device according to claim 5,

wherein the parameter for controlling a tactile sensation corresponding to the surface roughness of the object includes a value indicating a frequency of an oscillation that is caused in a target, and the parameter for controlling a tactile sensation corresponding to the density of the texture boundaries on the surface of the object includes a value indicating a duration time of the oscillation.

8. The image processing device according to claim 5,

wherein the parameter for controlling a tactile sensation corresponding to the surface roughness of the object includes a value of a voltage applied to targets, and

the parameter for controlling a tactile sensation corresponding to the density of the texture boundaries on the surface of the object includes a value indicating an interval of the targets to which the voltage is applied.

9. The image processing device according to claim 2,

wherein the cutaneous sensation control parameters include temperature sensation control parameters, and

the generation unit generates the temperature sensation control parameters on the basis of pixel values of the infrared image acquired by the infrared image acquisition unit.

10. The image processing device according to claim 9,

wherein the temperature sensation control parameters include an absolute value of a current applied to a target and a value indicating a direction of the current.

11. An image processing method comprising:

acquiring an infrared image of an imaged object by an image processing device;

acquiring a visible light image of the imaged object;

generating cutaneous sensation control parameters on the basis of the acquired infrared image; and

associating the acquired visible light image with the generated cutaneous sensation control parameters.

12. A program causing a computer that controls an image processing device to function as:

an infrared image acquisition unit that acquires an infrared image of an imaged object;

a visible light image acquisition unit that acquires a visible light image of the imaged object;

a generation unit that generates cutaneous sensation control parameters on the basis of the infrared image acquired by the infrared image acquisition unit; and

a data processing unit that associates the visible light image acquired by the visible light image acquisition unit with the cutaneous sensation control parameters generated by the generation unit.