Service providing apparatus and method

• US 10,394,519 B2
• Filed: 09/26/2017
• Issued: 08/27/2019
• Est. Priority Date: 10/11/2016
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Shintani, Tomoko, Yuhara, Hiromitsu, Soma, Eisuke
• Primary Examiner(s): Shah, Paras D
• Application Number:
  US15/716,388
• Publication Number:
  US 20180101354A1
• Time in Patent Office: 700 Days
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04W 4/48 for in-vehicle communication

Abstract

A service providing apparatus including an occupant detector configured to detect presence of each of a plurality of occupants in a vehicle and a control unit including a CPU and a memory coupled to the memory, wherein the CPU and the memory are configured to perform: estimating an individual feeling of the each of the plurality of occupants detected by the occupant detector; estimating a general mood representing an entire feeling of the plurality of occupants, based on the estimated individual feeling of the each of the plurality of occupants; deciding a service to be provided to a group of the plurality of occupants, based on the estimated general mood; and outputting a command to provide the decided service.

Claims

1. A service providing apparatus, comprising:

an occupant detecting sensor configured to detect presence of each of a plurality of occupants in a vehicle;

an image acquiring sensor configured to acquire an image of a face of the plurality of occupants;

a microphone configured to acquire an utterance of at least one of the plurality of occupants; and

a control unit including a CPU and a memory coupled to the memory, wherein the CPU and the memory are configured to;

estimate an individual feeling of each of the plurality of occupants detected by the occupant detecting sensor, based on the acquired image of the face of the occupant acquired by the image acquiring sensor;

estimate a general mood representing an entire feeling of the plurality of occupants, based on the estimated individual feeling of each of the plurality of occupants;

interpret a gist of an utterance of at least one of the plurality of occupants, based on the utterance acquired by the microphone;

select a voice information service providing information on the interpreted gist of the utterance when the estimated general mood is more than or equal to a predetermined value, and select a music service providing music when the estimated general mood is less than the predetermined value; and

output a command to provide the selected service.

2. The apparatus according to claim 1, wherein the CPU and the memory are configured to:

qualify the individual feeling of each of the plurality of occupants, and

qualify the general mood by dividing a sum of the qualified individual feeling for each of the plurality of occupants by a total number of the plurality of occupants detected.

3. The apparatus according to claim 1, further comprising a motion detector configured to detect a motion of each of the plurality of occupants, wherein the CPU and the memory are configured to:

estimate the individual feeling based on the motion detected by the motion detector.

4. The apparatus according to claim 1, wherein the CPU and the memory are configured to:

select the music service when the gist of the utterance is not interpreted.

5. A service providing apparatus, comprising:

an occupant detecting sensor configured to detect presence of each of a plurality of occupants in a vehicle;

an image acquiring sensor configured to acquire an image of a face of the plurality of occupants;

a microphone configured to acquire an utterance of at least one of the plurality of occupants; and

an electric control unit having a microprocessor and a memory, wherein the microprocessor is configured to function as;

an individual feeling estimator configured to estimate an individual feeling of the each of the plurality of occupants detected by the occupant detecting sensor, based on the acquired image acquired by the image acquiring sensor;

a general mood estimator configured to estimate a general mood representing an entire feeling of the plurality of occupants, based on the individual feeling of the each of the plurality of occupants estimated by the individual feeling estimator;

an utterance interpreter configured to interpret a gist of an utterance of at least one of the plurality of occupants, based on the utterance acquired by the microphone;

a service decider configured to select a voice information service providing information on the gist of the utterance interpreted by the utterance interpreter when the estimated general mood is more than or equal to a predetermined value, and to select a music service providing music when the estimated general mood is less than the predetermined value; and

a command outputter configured to output a command to provide the service selected by the service decider.

6. The apparatus according to claim 5, wherein:

the individual feeling estimator is configured to qualify the individual feeling of each of the plurality of occupants, and

the general mood estimator is configured to qualify the general mood by dividing a sum of the individual feeling qualified by the individual feeling estimator for each of the plurality of occupants by a total number of the plurality of occupants detected by the occupant detector.

7. The apparatus according to claim 5, further comprising a motion detector configured to detect a motion of each of the plurality of occupants,

wherein the individual feeling estimator is configured to estimate the individual feeling based on the motion detected by the motion detector.

8. The apparatus according to claim 5, wherein the service decider is configured to select the music service when the gist of the utterance is not interpreted by the utterance interpreter.

9. A service providing method, comprising:

detecting presence of each of a plurality of occupants in a vehicle;

acquiring images of faces of the plurality of occupants;

acquiring an utterance of at least one of the occupants;

estimating an individual feeling of each of the plurality of occupants detected, based on the acquired images of the faces of the plurality of occupants;

estimating a general mood representing an entire feeling of the plurality of occupants, based on the estimated individual feeling of each of the plurality of occupants;

interpreting a gist of the utterance of the at least one of the occupants;

selecting a voice information service providing information on the interpreted gist of the utterance when the estimated general mood is more than or equal to a predetermined value;

selecting a music service providing music when the estimated general mood is less than the predetermined value; and

outputting a command to provide the selected service.

10. The method according to claim 9, wherein:

estimating the individual feeling comprises qualifying the individual feeling of each of the plurality of occupants, and

estimating the general mood comprises qualifying the general mood by dividing a sum of the qualified individual feeling for each of the plurality of occupants by a total number of the plurality of occupants detected.

11. The method according to claim 9, further comprising detecting a motion of each of the plurality of occupants,

wherein estimating the individual feeling comprises estimating the individual feeling based on the detected motion.

12. The method according to claim 9, wherein selecting the service comprises selecting the music service when the gist of the utterance is not interpreted.