Information processing device, information processing method, and program

• US 10,809,972 B2
• Filed: 08/09/2017
• Issued: 10/20/2020
• Est. Priority Date: 09/27/2016
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Oide, Kenichi, Mizuuchi, Takayuki, Nishida, Osamu, Shibuya, Hirohisa, Usui, Taeko, Nakazono, Taisuke
• Primary Examiner(s): Kim, Paul
• Application Number:
  US16/333,742
• Publication Number:
  US 20190361666A1
• Time in Patent Office: 1,168 Days
• Field of Search: 381 58
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: H03G 3/3005 in amplifiers suitable for low-frequencies, e.g. audio amplifiers H03G3/32, H03G3/34 take precedence
• CPC Class Codes: H03G 3/32 the control being dependent upon ambient noise level or sound level
• CPC Class Codes: H04R 1/1041 Mechanical or electronic switches, or control elements switches in general H01H
• CPC Class Codes: H04R 1/1083 Reduction of ambient noise active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06
• CPC Class Codes: H04R 2430/01 Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 2460/01 Hearing devices using active noise cancellation
• CPC Class Codes: H04R 2460/07 Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
• CPC Class Codes: H04R 29/001 for loudspeakers H04R29/007 takes precedence
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04R 5/033 Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field

Abstract

To enable listening to audio in a more suitable mode without any complicated operation even in a situation in which the user'"'"'s state or situation successively changes. An information processing device including: a recognition processing unit that recognizes a user'"'"'s state in accordance with a detection result of a predetermined state or situation; and an output control unit that controls audio output from a predetermined output unit on the basis of a function map, which is selected in accordance with a predetermined condition, in which a setting related to control of the audio output is associated with each of a plurality of candidates for the user'"'"'s state, and the recognized user'"'"'s state.

Claims

1. An information processing device comprising:

a recognition processing unit that recognizes a user'"'"'s mobility state in accordance with a detection result of a predetermined state or situation;

an output control unit that controls audio output from a predetermined output unit on a basis of a function map, which is selected in accordance with a predetermined condition, in which a setting related to control of the audio output is associated with each of a plurality of candidates for the user'"'"'s mobility state, and the recognized user'"'"'s mobility state; and

a selection unit that employs, as the condition, at least one of a detection result of a predetermined state or situation or attribute information of a predetermined target and selects the function map in accordance with the condition from a plurality of function maps.

2. The information processing device according to claim 1, wherein, in the function map, a combination of settings related to each of a plurality of types of control is associated as the setting related to the control of the audio output for each of the plurality of candidates for the user'"'"'s mobility state.

3. The information processing device according to claim 2, wherein at least a part of the settings related to the plurality of types of control is a setting of a function related to control of the audio output.

4. The information processing device according to claim 1, wherein the user'"'"'s mobility state is a state related to the user'"'"'s action.

5. The information processing device according to claim 1, wherein, in a case in which a predetermined state has been recognized as the user'"'"'s mobility state, the output control unit takes over at least a part of the settings related to the control of the audio output in another state before transition to the predetermined state.

6. The information processing device according to claim 5, wherein the predetermined state is a state in which the user is still.

7. The information processing device according to claim 5, wherein the predetermined state is a state in which the user is riding a bicycle.

8. The information processing device according to claim 1, wherein, in a case in which the user'"'"'s mobility state has transitioned, the output control unit controls the audio output in accordance with states before and after the transition.

9. The information processing device according to claim 1, wherein the recognition processing unit recognizes the user'"'"'s mobility state in accordance with likelihood of each of one or more candidates for the user'"'"'s mobility state based on the detection result.

10. The information processing device according to claim 1, wherein the recognition processing unit recognizes the user'"'"'s mobility state in accordance with a result of machine learning based on a sample that associates the detection result acquired in the past and a result of recognizing the user'"'"'s mobility state in accordance with the detection result.

11. The information processing device according to claim 1, wherein the selection unit selects the function map in accordance with a result of machine learning based on a sample that associates the condition determined in the past and a result of selecting the function map in accordance with the condition.

12. The information processing device according to claim 1, wherein the output control unit controls the audio output in accordance with the recognized user'"'"'s mobility state on a basis of the function map selected by the user.

13. The information processing device according to claim 1, wherein at least a part of a plurality of the function maps is updated on a basis of a user input.

14. The information processing device according to claim 1, wherein the recognition processing unit corrects a result of recognizing the user'"'"'s mobility state based on a first detection result of a predetermined state or situation obtained by a first detection unit in accordance with a second detection result of a predetermined state or situation obtained by a second detection unit that is different from the first detection unit.

15. The information processing device according to claim 14, wherein the recognition processing unit activates the second detection unit in accordance with the result of recognizing the user'"'"'s mobility state based on the first detection result.

16. The information processing device according to claim 15,

wherein the recognition processing unit

activates the second detection unit in a case in which the result of recognizing the user'"'"'s mobility state based on the first detection result indicates a predetermined state, and

stops the second detection unit in a case in which the user'"'"'s mobility state based on the first detection result indicates a state other than the predetermined state after activating the second detection unit.

17. The information processing device according to claim 15, wherein the recognition processing unit corrects the result of recognizing the user'"'"'s mobility state based on the first detection result in accordance with the second detection result obtained by the second detection unit at a timing later than a timing at which the second detection unit is activated.

18. An information processing method comprising, by a computer:

recognizing a user'"'"'s mobility state in accordance with a detection result of a predetermined state or situation;

controlling audio output from a predetermined output unit on a basis of a function map, which is selected in accordance with a predetermined condition, in which a setting related to control of the audio output is associated with each of a plurality of candidates for the user'"'"'s mobility state, and the recognized user'"'"'s mobility state; and

employing, as the condition, at least one of a detection result of a predetermined state or situation or attribute information of a predetermined target and selecting the function map in accordance with the condition from a plurality of function maps.

19. The method of claim 18, further comprising:

updating, on a basis of a user input, at least a part of the plurality of function maps.

20. A non-transitory computer readable medium storing a program that causes a computer to execute:

recognizing a user'"'"'s mobility state in accordance with a detection result of a predetermined state or situation;

controlling audio output from a predetermined output unit on a basis of a function map, which is selected in accordance with a predetermined condition, in which a setting related to control of the audio output is associated with each of a plurality of candidates for the user'"'"'s mobility state, and the recognized user'"'"'s mobility state; and

employing, as the condition, at least one of a detection result of a predetermined state or situation or attribute information of a predetermined target and selecting the function map in accordance with the condition from a plurality of function maps.