Systems and methods of an adaptive interface to improve user experience within a vehicle

• US 10,106,173 B2
• Filed: 07/22/2015
• Issued: 10/23/2018
• Est. Priority Date: 07/22/2014
• Status: Expired due to Fees

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Goldman-Shenhar, Claudia V., Degani, Asaf, Deutsch, Omer
• Primary Examiner(s): Lee, Tyler J
• Application Number:
  US15/327,521
• Publication Number:
  US 20170174230A1
• Time in Patent Office: 1,189 Days
• Field of Search: 701 36
• CPC Class Codes: B60K 2360/151 Instrument output devices for configurable output
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/20 Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/65 Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
• CPC Class Codes: B60W 50/10 Interpretation of driver requests or demands
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

The present disclosure relates to a computer-readable device cause a processor to perform operations for interpreting a user request, such as a tactile inputs, gestures, and speech, to a vehicle system. The operations include receiving an input data package comprising user communications. The operations then determine using a human-machine interface whether the input data package contains an implicit user request or an explicit user request. The operations also assign a level of abstraction to the control language data set. Also disclosed are methods for receiving, interpreting, and storing a user request at one or more levels of abstraction.

Claims

1. A computer-readable hardware storage device comprising instructions, which, when executed by a processor, cause the processor to perform operations, for interpreting a user request to a first tangible vehicle system, comprising:

receiving an input data package comprising a sequence of user communications comprising a cognitive state based on perceived behavior displayed by a user, a vehicle system data package comprising a vehicle condition internal to the vehicle, and an environmental measurement data package comprising at least one condition external to the vehicle;

determining, using a human-machine interface, that the input data package contains an implicit user request;

determining a level of abstraction corresponding to the implicit user request;

assigning the level of abstraction determined to the user request for subsequent use in controlling a second tangible vehicle system comprising a tangible vehicle device used to reflect the cognitive state of the user; and

presenting, to the user at the vehicle device, a predetermined control selection based on the assigned level of abstraction and cognitive state of the user.

2. The device of claim 1, wherein the operations further comprise determining whether the implicit user request has been previously stored at the level of abstraction.

3. The device of claim 2, wherein, if the implicit request has been previously stored, the system can recall the level of abstraction based on the user request.

4. The device of claim 1, wherein the operations further comprise communicating the implicit user request to a destination vehicle hardware subsystem for execution.

5. The device of claim 1, wherein the level of abstraction is a first level of abstraction and the predetermined control selection comprises output commands based on the first level of abstraction and a second level of abstraction.

6. The device of claim 5, wherein the operations further comprise adjusting the output commands according to the first level of abstraction or the second level of abstraction and presenting the output commands adjusted for receipt by the user by way of a display device.

7. A computer-readable hardware storage device comprising instructions, which, when executed by a processor, cause the processor to perform operations, for interpreting a user request to a first tangible vehicle system, comprising:

receiving an input data package comprising a sequence of user communications comprising a cognitive state based on perceived behavior displayed by a user, a vehicle system data package comprising a vehicle condition internal to the vehicle, and an environmental measurement data package comprising at least one condition external to the vehicle;

determining, using a human-machine interface, that the input data package contains an explicit user request;

determining a level of abstraction corresponding to the explicit user request;

assigning, the level of abstraction determined to the user request for subsequent use in controlling a second tangible vehicle system comprising a tangible vehicle device used to reflect the cognitive state of the user; and

presenting, to the user at the vehicle device, a predetermined control selection based on the assigned level of abstraction and cognitive state of the user.

8. The device of claim 7, wherein the operations further comprise determining whether the explicit user request has been previously stored at the level of abstraction.

9. The device of claim 8, wherein, if the explicit request has been previously stored the system can recall the level of abstraction based on the user request.

10. The device of claim 7, wherein the operations further comprise communicating the explicit user request to a destination vehicle hardware subsystem for execution.

11. The device of claim 7, wherein the level of abstraction is a first level of abstraction and the predetermined control selection comprises output commands based on the first level of abstraction and a second level of abstraction.

12. The device of claim 11, wherein the operations further comprise adjusting the output commands according to the first level of abstraction or the second level of abstraction and presenting the output commands adjusted for receipt by the user by way of a display device.

13. A method for interpreting a user request to a first tangible vehicle system, comprising:

receiving, by a system having a processor, an input data package comprising a sequence of user communications comprising a cognitive state based on perceived behavior displayed by a user, a vehicle system data package comprising a vehicle condition internal to the vehicle, and an environmental measurement data package comprising at least one condition external to the vehicle;

determining the user request is implicit where the system requires additional information to execute the user request,

determining the user request is explicit where the system may directly execute the user request and wherein the user request is implicit;

determining a level of abstraction corresponding to the implicit user request;

assigning, the level of abstraction determined to the user request for subsequent user in controlling a second tangible vehicle system comprising a tangible vehicle device used to reflect the cognitive state of the user; and

presenting to the user at the vehicle device, a predetermined control selection based on the assigned level of abstraction and cognitive state of the user.

14. The method of claim 13, further comprises determining whether the explicit user request has been previously stored at the level of abstraction.

15. The method of claim 14, wherein the explicit request has been previously stored if the system recalls the level of abstraction based on the user request.

16. The method of claim 14, wherein the explicit request is stored at the level of abstraction determined by a classification of user input into the system.

17. The method of claim 13, further comprises determining whether the implicit user request has been previously stored at the level of abstraction.

18. The method of claim 17, wherein the implicit request has been previously stored if the system can recall the level of abstraction based on the user request.

19. The method of claim 17, wherein the implicit request is stored at the level of abstraction determined by a classification of user input into the system.

20. The method of claim 17, wherein the level of abstraction is a first level of abstraction and the predetermined control selection comprises commands based on the first level of abstraction and a second level of abstraction.