INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND RECORDING MEDIUM

• US 20170162195A1
• Filed: 11/17/2016
• Published: 06/08/2017
• Est. Priority Date: 12/04/2015
• Status: Abandoned Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Umesawa, Takeo
• Application Number:
  US15/354,873
• Publication Number:
  US 20170162195A1
• Time in Patent Office: Days
• CPC Class Codes: G01H 3/125 for representing acoustic field distribution using optical means G01H9/002; sonar systems for imaging G01S7/56, G01S15/89; acoustic holography G03H3/00
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04R 1/326 for microphones H04R1/34 and H04R1/40 take precedence
• CPC Class Codes: H04R 29/00 Monitoring arrangements; Testing arrangements for hearing aids H04R25/30; detection of loudspeaker connection H04R5/04; sound-field adaptation dependent on speaker detection H04S7/308
• CPC Class Codes: H04R 29/008 Visual indication of individual signal levels visual indication of stereophonic sound image H04S7/40
• CPC Class Codes: H04S 7/40 Visual indication of stereophonic sound image

Abstract

An information processing apparatus includes an obtaining unit configured to obtain an image captured by an imaging unit, a detection unit configured to detect target sound corresponding to a detection target from audio data obtained by a sound collection unit, an area estimation unit configured to estimate a detectable area where the target sound can be detected in an area indicated by the captured image on a basis of at least one of a directionality of the sound collection unit and a distance from a position of a target sound source that generates the target sound, and a generation unit configured to generate an area image indicating the detectable area.

Claims

1. An information processing apparatus comprising:

an obtaining unit configured to obtain an image captured by an imaging unit;

a detection unit configured to detect target sound corresponding to a detection target from audio data obtained by a sound collection unit;

an area estimation unit configured to estimate a detectable area where the target sound can be detected in an area indicated by the captured image on a basis of at least one of a directionality of the sound collection unit and a distance from a position of a target sound source that generates the target sound; and

a generation unit configured to generate an area image indicating the detectable area.

2. The information processing apparatus according to claim 1, further comprising:

a display control unit configured to display the captured image on which the area image is superposed on a display unit.

3. The information processing apparatus according to claim 1, further comprising:

a transmission unit configured to transmit the captured image on which the area image is superposed to an external apparatus.

4. The information processing apparatus according to claim 1, further comprising:

a sound pressure estimation unit configured to estimate sound pressures at a plurality of positions in an area of the captured image on a basis of the directionality,

wherein the area estimation unit estimates the detectable area on a basis of sound pressure estimated values estimated by the sound pressure estimation unit.

5. The information processing apparatus according to claim 4, further comprising:

a storage unit configured to store a correspondence table in which the sound pressure and a sound detection probability with respect to the sound pressure are stored while being associated with each other; and

a conversion unit configured to refer to the correspondence table and convert the sound pressure estimated value into the detection probability,

wherein the area estimation unit estimates the detectable area on a basis of the detection probability.

6. The information processing apparatus according to claim 5, wherein the area estimation unit estimates an area where the detection probability is higher than or equal to a threshold as the detectable area.

7. The information processing apparatus according to claim 6, further comprising:

an acceptance unit configured to accept a change instruction of the threshold,

wherein the area estimation unit changes the detectable area on a basis of the threshold related to the change instruction.

8. The information processing apparatus according to claim 1, wherein the area estimation unit estimates the detectable area in an area at a predetermined distance from the sound collection unit indicated by the captured image.

9. The information processing apparatus according to claim 8, further comprising:

an acceptance unit configured to accept a change instruction of a distance from the sound collection unit,

wherein the area estimation unit changes the detectable area on a basis of the distance related to the change instruction.

10. The information processing apparatus according to claim 1, wherein the area estimation unit estimates the detectable area where the target sound can be detected in the area indicated by the captured image on a basis of the distance from the position of the target sound source where the target sound is generated.

11. The information processing apparatus according to claim 10, further comprising:

an identification unit configured to identify a sound pressure level of the target sound and a sound pressure level of background sound,

wherein the area estimation unit estimates the detectable area on a basis of the sound pressure level of the target sound, the sound pressure level of the background sound, and the distance from the position of the target sound source.

12. The information processing apparatus according to claim 11, further comprising:

a level ratio estimation unit configured to estimate a level ratio of the sound pressure level of the target sound and the sound pressure level of the background sound on a basis of the sound pressure level of the target sound, the sound pressure level of the background sound, and the distance from the position of the target sound source,

wherein the area estimation unit estimates the detectable area on a basis of a level ratio estimated value estimated by the level ratio estimation unit.

13. The information processing apparatus according to claim 12, further comprising:

a storage unit configured to store a correspondence table in which the level ratio and the detection probability of the sound with respect to the level ratio are stored while being associated with each other; and

a conversion unit configured to refer to the correspondence table and convert the level ratio estimated value into the detection probability,

wherein the area estimation unit estimates the detectable area on a basis of the detection probability.

14. The information processing apparatus according to claim 10, further comprising:

an extraction unit configured to extract a floor surface area from the captured image; and

a projection unit configured to project the detectable area onto the floor surface area,

wherein the generation unit generates the area image indicating the detectable area projected onto the floor surface area.

15. An information processing method executed by an information processing apparatus, the information processing method comprising:

obtaining an image captured by an imaging unit;

detecting target sound corresponding to a detection target from audio data obtained by a sound collection unit;

estimating a detectable area where the target sound can be detected in an area indicated by the captured image on a basis of at least one of a directionality of the sound collection unit and a distance from a position of a target sound source that generates the target sound; and

generating an area image indicating the detectable area.

16. A non-transitory recording medium storing a program for causing a computer to function as:

an obtaining unit configured to obtain an image captured by an imaging unit;

a detection unit configured to detect target sound corresponding to a detection target from audio data obtained by a sound collection unit;

an area estimation unit configured to estimate a detectable area where the target sound can be detected in an area indicated by the captured image on a basis of at least one of a directionality of the sound collection unit and a distance from a position of a target sound source that generates the target sound; and

a generation unit configured to generate an area image indicating the detectable area.