Method for providing vehicle AI service and device using the same

• US 10,741,178 B2
• Filed: 02/23/2018
• Issued: 08/11/2020
• Est. Priority Date: 02/02/2018
• Status: Active Grant

• Current Assignee: OBIGO Inc.
• Original Assignee: OBIGO Inc.
• Inventors: Jo, Ki Hyun, Lee, Jung Seok
• Primary Examiner(s): Hoque, Nafiz E
• Application Number:
  US15/903,397
• Publication Number:
  US 20190244607A1
• Time in Patent Office: 900 Days
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context

Abstract

A method for providing a vehicle AI service is provided. The method includes steps of: an AI service providing device (a) supporting an AI server to extract from a voice of a user (i) at least one of skill candidates including service categories and (ii) at least one of command candidates, to create voice analysis data, and receiving it from the AI server; and (b) (I) analyzing at least one of (i) the voice analysis data, (ii) second data created by analyzing voices of other users within a certain time, (iii) third data created by analyzing voices of the user within a particular time, and (iv) fourth data having information on context of the user, and (II) recognizing an intention included in the voice and determining a final skill and a final command matching the intention; wherein each of the data includes the skill candidates and the command candidates.

Claims

1. A method for providing a vehicle Artificial Intelligence (AI) service, comprising steps of:

(a) an AI service providing device, if a voice of a specific user is acquired from a voice receiver, supporting an AI server to extract from the voice (i) at least one of skill candidates each of which includes a service category and (ii) at least one of command candidates, to thereby create voice analysis data, and receiving the voice analysis data from the AI server; and

(b) the AI service providing device (I) analyzing at least one of (i) first data including the voice analysis data, (ii) second data including real-time trend data created by analyzing voices of other users acquired within a certain time period, (iii) third data including user history data created by analyzing voices of the specific user acquired within a particular time period, and (iv) fourth data including situation data having information on context of the specific user, and then (II) recognizing an intention included in the voice of the specific user acquired at the step of (a) and determining a final skill and a final command which match the intention;

wherein each of the first data, the second data, the third data, and the fourth data includes at least one of the skill candidates and at least one of the command candidates;

wherein each of m-th data {m|m∈

l, 2, 3, 4} includes (i) information on each of (m-k)-th skill scores which represents an extent of the intention analyzed for each of (m-k)-th skill candidates {k|k∈

1, 2, 3, . . . , kk} and (ii) information on each of (m-n)-th command scores {n|n∈

1, 2, 3, . . . , nk} which represents an extent of the intention analyzed for each of (m-n)-th command candidates;

wherein, at the step of (b), if a specific command candidate among the command candidates has a highest score among (1-k)-th skill scores and (1-n)-th command scores included in the first data, the AI service providing device determines the specific command candidate as the final command, and selects the final skill from at least part of the skill candidates capable of executing commands corresponding to the specific command candidate;

wherein, on condition that a-th skill candidates {a|a∈

1, 2, 3, . . . , ak} are among the at least part of the skill candidates capable of executing commands corresponding to the specific command candidate, the AI service providing device calculates each of a-th matching scores corresponding to the intention, for each of the a-th skill candidates by referring to an m-th weight factor which is a weight factor of the m-th data, to thereby determine a specific skill candidate with a highest score among the a-th matching scores as the final skill, wherein the a-th matching scores include respective summations of multiplications of the m-th weight factor by each skill score of the m-th data corresponding to each of the a-th skill candidates.

2. The method of claim 1, wherein, at the step of (b), if a specific skill candidate among the skill candidates has a highest score among (1-k)-th skill scores and (1-n)-th command scores included in the first data, the AI service providing device determines the specific skill candidate as the final skill, and selects the final command from at least part of the command candidates capable of performing skills corresponding to the specific skill candidate.

6. The method of claim 1, wherein the third data includes information created by analyzing the voices of the specific user acquired within the particular time period at a particular area which includes a current location, wherein the particular time period contains at least one of (i) a certain past time window and (ii) a current time.

7. The method of claim 1, wherein the fourth data includes at least one of (i) vehicle information on at least one of a model name of a vehicle and a type of its engine;

(ii) driving information on at least one of speed of the vehicle, its transmission operating mode, and its parking state;

(iii) information on at least one of a location of the vehicle, direction of the vehicle and a name of a road on which the vehicle is in operation;

(iv) situation information on at least one of a current time and current weather; and

(v) app information on at least one application currently being executed in a device installed in or connected with the vehicle.

3. A method for providing a vehicle Artificial Intelligence (AI) service, comprising steps of:

(a) an AI service providing device, if a voice of a specific user is acquired from a voice receiver, supporting an AI server to extract from the voice (i) at least one of skill candidates each of which includes a service category and (ii) at least one of command candidates, to thereby create voice analysis data, and receiving the voice analysis data from the AI server; and

(b) the AI service providing device (I) analyzing at least one of (i) first data including the voice analysis data, (ii) second data including real-time trend data created by analyzing voices of other users acquired within a certain time period, (iii) third data including user history data created by analyzing voices of the specific user acquired within a particular time period, and (iv) fourth data including situation data having information on context of the specific user, and then (II) recognizing an intention included in the voice of the specific user acquired at the step of (a) and determining a final skill and a final command which match the intention;

wherein each of the first data, the second data, the third data, and the fourth data includes at least one of the skill candidates and at least one of the command candidates;

wherein each of m-th data {m|m∈

1, 2, 3, 4} includes (i) information on each of (m-k)-th skill scores which represents an extent of the intention analyzed for each of (m-k)-th skill candidates {k|k∈

1, 2, 3, . . . , kk} and (ii) information on each of (m-n)-th command scores {n|n∈

1, 2, 3, . . . , nk} which represents an extent of the intention analyzed for each of (m-n)-th command candidates;

wherein, at the step of (b), if a specific skill candidate among the skill candidates has a highest score among (1-k)-th skill scores and (1-n)-th command scores included in the first data, the AI service providing device determines the specific skill candidate as the final skill, and selects the final command from at least part of the command candidates capable of performing skills corresponding to the specific skill candidate;

wherein, on condition that a-th command candidates {a|a∈

1, 2, 3, . . . , ak} are among the at least part of the command candidates capable of performing skills corresponding to the specific skill candidate, the AI service providing device calculates each of a-th matching scores corresponding to the intention, for each of the a-th command candidates by referring to an m-th weight factor which is a weight factor of the m-th data, to thereby determine a specific command candidate with a highest score among the a-th matching scores as the final command, wherein the a-th matching scores include respective summations of multiplications of the m-th weight factor by each score of the m-th data corresponding to each of the a-th command candidates.

4. A method for providing a vehicle Artificial Intelligence (AI) service, comprising steps of:

(a) an AI service providing device, if a voice of a specific user is acquired from a voice receiver, supporting an Al server to extract from the voice (i) at least one of skill candidates each of which includes a service category and (ii) at least one of command candidates, to thereby create voice analysis data, and receiving the voice analysis data from the AI server;

(b) the AI service providing device (I) analyzing at least one of (i) first data including the voice analysis data, (ii) second data including real-time trend data created by analyzing voices of other users acquired within a certain time period, (iii) third data including user history data created by analyzing voices of the specific user acquired within a particular time period, and (iv) fourth data including situation data having information on context of the specific user, and then (II) recognizing an intention included in the voice of the specific user acquired at the step of (a) and determining a final skill and a final command which match the intention;

wherein each of the first data, the second data, the third data, and the fourth data includes at least one of the skill candidates and at least one of the command candidates;

wherein each of m-th data {m|M∈

1, 2, 3, 4} includes (i) information on each of (m-k)-th skill scores which represents an extent of the intention analyzed for each of (m-k)-th skill candidates {k|k∈

1, 2, 3, . . . , k_n} and (ii) information on each of (m-n)-th command scores {n|n∈

1, 2, 3, . . . , n_k} which represents an extent of the intention analyzed for each of (m-n)-th command candidates;

wherein, at the step of (b), if a specific command candidate has a highest value among (i) values of respective multiplications of each of the (m-k)-th skill scores by an m-th weight factor which is a weight factor of the m-th data, and (ii) values of respective multiplications of each of the (m-n)-th command scores by the m-th weight factor, the AI service providing device determines the specific command candidate as the final command, and selects the final skill from at least part of the skill candidates capable of executing commands corresponding to the specific command candidate.

5. A method for providing a vehicle Artificial Intelligence (AI) service, comprising steps of:

(a) an AI service providing device, if a voice of a specific user is acquired from a voice receiver, supporting an AI server to extract from the voice (i) at least one of skill candidates each of which includes a service category and (ii) at least one of command candidates, to thereby create voice analysis data, and receiving the voice analysis data from the AI server, and

(b) the AI service providing device (I) analyzing at least one of (i) first data including the voice analysis data, (ii) second data including real-time trend data created by analyzing voices of other users acquired within a certain time period, (iii) third data including user history data created by analyzing voices of the specific user acquired within a particular time period, and (iv) fourth data including situation data having information on context of the specific user, and then (II) recognizing an intention included in the voice of the specific user acquired at the step of (a) and determining a final skill and a final command which match the intention;

wherein each of the first data, the second data, the third data, and the fourth data includes at least one of the skill candidates and at least one of the command candidates;

wherein each of m-th data {m|m∈

1, 2, 3, 4} includes (i) information on each of (m-k)-th skill scores which represents an extent of the intention analyzed for each of (m-k)-th skill candidates {k|k∈

1, 2, 3, . . . , kk} and (ii) information on each of (m-n)-th command scores {n|n∈

1, 2, 3, . . . , nk} which represents an extent of the intention analyzed for each of (m-n)-th command candidates;

wherein, at the step of (b), if a specific skill candidate has a highest value among (i) values of respective multiplications of each of the (m-k)-th skill scores by an m-th weight factor which is a weight factor of the m-th data, and (ii) values of respective multiplications of each of the (m-n)-th command scores by the m-th weight factor, the AI service providing device determines the specific skill candidate as the final skill, and selects the final command from at least part of the command candidates capable of performing skills corresponding to the specific skill candidate.

8. An Artificial Intelligence (AI) service providing device for providing a vehicle AI service, comprising:

a communication part for receiving voice analysis data from an AI server if the AI server acquires a voice of a specific user from a voice receiver, and extract from the voice (i) at least one of skill candidates each of which includes a service category and (ii) at least one of command candidates, to thereby create the voice analysis data; and

a processor for (I) analyzing at least one of (i) first data including the voice analysis data, (ii) second data including real-time trend data created by analyzing voices of other users acquired within a certain time period, (iii) third data including user history data created by analyzing voices of the specific user acquired within a particular time period, and (iv) fourth data including situation data having information on context of the specific user, and then (II) recognizing an intention included in the voice of the specific user acquired from the communication part and determining a final skill and a final command which match the intention;

wherein each of the first data, the second data, the third data, and the fourth data includes at least one of the skill candidates and at least one of the command candidates

wherein each of m-th data {m|m∈

1, 2, 3, 4} includes (i) information on each of (m-k)-th skill scores which represents an extent of the intention analyzed for each of (m-k)-th skill candidates {k|k∈

1, 2, 3, . . . , kk} and (ii) information on each of (m-n)-th command scores {n|n∈

1, 2, 3, . . . , nk} which represents an extent of the intention analyzed for each of (m-n)-th command candidates;

wherein, if a specific command candidate among the command candidates has a highest score among (1-k)-th skill scores and (1-n)-th command scores included in the first data, the processor determines the specific command candidate as the final command, and selects the final skill from at least part of the skill candidates capable of executing commands corresponding to the specific command candidate;

wherein, on condition that a-th skill candidates {a|a∈

1, 2, 3, . . . , ak} are among the at least part of the skill candidates capable of executing commands corresponding to the specific command candidate, the processor calculates each of a-th matching scores corresponding to the intention, for each of the a-th skill candidates by referring to an m-th weight factor which is a weight factor of the m-th data, to thereby determine a specific skill candidate with a highest score among the a-th matching scores as the final skill, wherein the a-th matching scores include respective summations of multiplications of the m-th weight factor by each skill score of the m-th data corresponding to each of the a-th skill candidates.

9. The AI service providing device of claim 8, wherein, if a specific skill candidate among the skill candidates has a highest score among (1-k)-th skill scores and (1-n)-th command scores included in the first data, the processor determines the specific skill candidate as the final skill, and selects the final command from at least part of the command candidates capable of performing skills corresponding to the specific skill candidate.

13. The AI service providing device of claim 8, wherein the third data includes information created by analyzing the voices of the specific user acquired within the particular time period at a particular area which includes a current location, wherein the particular time period contains at least one of (i) a certain past time window and (ii) a current time.

14. The AI service providing device of claim 8, wherein the fourth data includes at least one of (i) vehicle information on at least one of a model name of a vehicle and a type of its engine;

(ii) driving information on at least one of speed of the vehicle, its transmission operating mode, and its parking state;

(iii) information on at least one of a location of the vehicle, direction of the vehicle and a name of a road on which the vehicle is in operation;

(iv) situation information on at least one of a current time and current weather; and

(v) app information on at least one application currently being executed in a device installed in or connected with the vehicle.

10. An Artificial Intelligence (AI) service providing device for providing a vehicle AI service, comprising:

a communication part for receiving voice analysis data from an AI server if the AI server acquires a voice of a specific user from a voice receiver, and extract from the voice (i) at least one of skill candidates each of which includes a service category and (ii) at least one of command candidates, to thereby create the voice analysis data; and

a processor for (I) analyzing at least one of (i) first data including the voice analysis data, (ii) second data including real-time trend data created by analyzing voices of other users acquired within a certain time period, (iii) third data including user history data created by analyzing voices of the specific user acquired within a particular time period, and (iv) fourth data including situation data having information on context of the specific user, and then (II) recognizing an intention included in the voice of the specific user acquired from the communication part and determining a final skill and a final command which match the intention;

wherein each of the first data, the second data, the third data, and the fourth data includes at least one of the skill candidates and at least one of the command candidates;

wherein each of m-th data {m|m∈

1, 2, 3, 4} includes (i) information on each of (m-k)-th skill scores which represents an extent of the intention analyzed for each of (m-k)-th skill candidates {k|k∈

1, 2, 3, ..., kk} and (ii) information on each of (m-n)-th command scores {n|n∈

1, 2, 3, ..., nk} which represents an extent of the intention analyzed for each of (m-n)-th command candidates;

wherein, if a specific skill candidate among the skill candidates has a highest score among (1-k)-th skill scores and (1-n)-th command scores included in the first data, the processor determines the specific skill candidate as the final skill, and selects the final command from at least part of the command candidates capable of performing skills corresponding to the specific skill candidate;

wherein, on condition that a-th command candidates {a|a∈

1, 2, 3, . . . , ak} are among the at least part of the command candidates capable of performing skills corresponding to the specific skill candidate, the processor calculates each of a-th matching scores corresponding to the intention, for each of the a-th command candidates by referring to an m-th weight factor which is a weight factor of the m-th data, to thereby determine a specific command candidate with a highest score among the a-th matching scores as the final command, wherein the a-th matching scores include respective summations of multiplications of the m-th weight factor by each score of the m-th data corresponding to each of the a-th command candidates.

11. An Artificial Intelligence (AI) service providing device for providing a vehicle AI service, comprising:

a communication part for receiving voice analysis data from an AI server if the AI server acquires a voice of a specific user from a voice receiver, and extract from the voice (i) at least one of skill candidates each of which includes a service category and (ii) at least one of command candidates, to thereby create the voice analysis data; and

a processor for (I) analyzing at least one of (i) first data including the voice analysis data, (ii) second data including real-time trend data created by analyzing voices of other users acquired within a certain time period, (iii) third data including user history data created by analyzing voices of the specific user acquired within a particular time period, and (iv) fourth data including situation data having information on context of the specific user, and then (II) recognizing an intention included in the voice of the specific user acquired from the communication part and determining a final skill and a final command which match the intention;

wherein each of the first data, the second data, the third data, and the fourth data includes at least one of the skill candidates and at least one of the command candidates;

wherein each of m-th data {m|m∈

1, 2, 3, 4} includes (i) information on each of (m-k)-th skill scores which represents an extent of the intention analyzed for each of (m-k)-th skill candidates {k|k∈

1, 2, 3, . . . , kk} and (ii) information on each of (m-n)-th command scores {n|n∈

1, 2, 3, . . . , nk} which represents an extent of the intention analyzed for each of (m-n)-th command candidates;

wherein, if a specific command candidate has a highest value among (i) values of respective multiplications of each of the (m-k)-th skill scores by an m-th weight factor which is a weight factor of the m-th data, and (ii) values of respective multiplications of each of the (m-n)-th command scores by the m-th weight factor, the processor determines the specific command candidate as the final command, and selects the final skill from at least part of the skill candidates capable of executing commands corresponding to the specific command candidate.

12. An Artificial Intelligence (AI) service providing device for providing a vehicle AI service, comprising:

a communication part for receiving voice analysis data from an AI server if the AI server acquires a voice of a specific user from a voice receiver, and extract from the voice (i) at least one of skill candidates each of which includes a service category and (ii) at least one of command candidates, to thereby create the voice analysis data; and

a processor for (I) analyzing at least one of (i) first data including the voice analysis data, (ii) second data including real-time trend data created by analyzing voices of other users acquired within a certain time period, (iii) third data including user history data created by analyzing voices of the specific user acquired within a particular time period, and (iv) fourth data including situation data having information on context of the specific user, and then (II) recognizing an intention included in the voice of the specific user acquired from the communication part and determining a final skill and a final command which match the intention;

wherein each of the first data, the second data, the third data, and the fourth data includes at least one of the skill candidates and at least one of the command candidates;

wherein each of m-th data {m|m∈

1, 2, 3, 4} includes (i) information on each of (m-k)-th skill scores which represents an extent of the intention analyzed for each of (m-k)-th skill candidates {k|k∈

1, 2, 3, . . . , kk} and (ii) information on each of (m-n)-th command scores {n|n∈

1, 2, 3, . . . , nk} which represents an extent of the intention analyzed for each of (m-n)-th command candidates;

wherein, if a specific skill candidate has a highest value among (i) values of respective multiplications of each of the (m-k)-th skill scores by an m-th weight factor which is a weight factor of the m-th data, and (ii) values of respective multiplications of each of the (m-n)-th command scores by the m-th weight factor, the processor determines the specific skill candidate as the final skill, and selects the final command from at least part of the command candidates capable of performing skills corresponding to the specific skill candidate.