System and method for dialog-enabled context-dependent and user-centric content presentation

• US 10,209,853 B2
• Filed: 12/11/2014
• Issued: 02/19/2019
• Est. Priority Date: 12/20/2013
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Weng, Fuliang, Xu, Kui, Liu, Fei, Zhao, Lin, Feng, Zhe, Shen, Zhongnan
• Primary Examiner(s): Weng, Pei Yong
• Application Number:
  US15/104,695
• Publication Number:
  US 20160313868A1
• Time in Patent Office: 1,531 Days
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/148 Instrument input by voice
• CPC Class Codes: B60K 2360/1868 according to driving situations
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/654 the user being the driver
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

An in-vehicle infotainment system, smart home information access and device control unit, or mobile system presents summarized information to a user based on a user preference model that is associated with the user. The system modifies the presentation of information to the user based on environmental context data about the vehicle and user context data about the activity of the user. During presentation of the information, the system modifies the content and presentation of the summarized information in response to multi-modal input requests from the user.

Claims

1. A content presentation system in a motor vehicle comprising:

a network device configured to retrieve information from a plurality of information sources through a data network;

a memory configured to store a user preference model corresponding to a user of the content presentation system;

plurality of output devices;

an in-vehicle sensor configured to generate data corresponding to motion of the motor vehicle and an environment around the motor vehicle, the in-vehicle sensor comprising one or more of;

a speedometer;

a light sensor;

a humidity sensor;

an external radar; and

an external parking and collision avoidance camera; and

a processor operatively connected to the network device, the memory, the plurality of output devices, and the in-vehicle sensor, the processor being configured to;

retrieve information from the plurality of information sources corresponding to a plurality of predetermined topics with reference to the user preference model;

generate a plurality of summarized presentations of the information for each topic in the plurality of topics each summarized presentation including a level of detail that is selected based on at least one of the motion of the motor vehicle and the level of traffic around the motor vehicle that are detected using the in-vehicle sensor; and

generate an output with at least one of the plurality of output devices for the plurality of summarized presentations for the plurality of topics with at least one output device in the plurality of output devices selected based on at least one of the motion of the motor vehicle and the level of traffic around the motor vehicle in a predetermined format for the user with reference to the user preference model.

2. The content presentation system of claim 1, the processor being further configured to:

generate the output of a first summarized presentation in the plurality of summarized presentations with an audio output device in the plurality of output devices and a second summarized presentation in the plurality of presentations with a head up display (HUD) in the plurality of output devices in response to detection of a heavy traffic level around the motor vehicle.

3. The content presentation system of claim 1, the processor being further configured to:

generate the output of the plurality of summarized presentations with an LCD panel video output device in the plurality of output devices in response to detection that the motor vehicle is halted.

4. The content presentation system of claim 1, the processor being further configured to:

generate one summarized presentation in the plurality of summarized presentations including a plurality of summarized sets of data corresponding to a plurality of relevance levels;

set a relevance threshold with reference to the data corresponding to at least one of the level of traffic around the motor vehicle and the motion of the motor vehicle; and

generate the output of the one summarized presentation including only a portion of the plurality of summarized sets of data corresponding to a relevance level that exceeds the relevance threshold.

5. The content presentation system of claim 1 further comprising:

an input device configured to receive input from the user; and

the processor being operatively connected to the input device and further configured to;

receive the input from the user with the user input device during generation of the plurality of summarized outputs with the output device; and

adjust the predetermined format of the plurality of summarized outputs with reference to the input from the user.

6. The content presentation system of claim 5, the processor being further configured to:

truncate the output of one summarized presentation in the plurality of summarized presentations in response to the input from the user; and

begin output of another summarized presentation in the plurality of summarized presentations in response to the input from the user.

7. A method of presenting content in a content presentation system in a motor vehicle comprising:

retrieving with a network device information from a plurality of information sources corresponding to a plurality of predetermined topics with reference to a user preference model stored in a memory;

receiving data corresponding to at least one of a motion of the motor vehicle and an environment around the motor vehicle with an with an in-vehicle sensor comprising one or more of;

a speedometer;

a light sensor;

a humidity sensor;

an external radar; and

an external parking and collision avoidance camera;

generating with a processor a plurality of summarized presentations of the information for each topic in the plurality of topics, each summarized presentation including a level of detail that is selected based on at least one of the motion of the motor vehicle and the level of traffic around the motor vehicle that are detected using the in-vehicle sensor; and

generating with the processor an output for the plurality of summarized presentations for the plurality of topics with at least one output device in a plurality of output devices in the motor vehicle selected based on at least one of the motion of the motor vehicle and the level of traffic around the motor vehicle in a predetermined format for a user with reference to the user preference model.

8. The method of claim 7, the generation of the output of the plurality of summarized presentations further comprising:

generating the output of a first summarized presentation in the plurality of summarized presentations with an audio output device in the plurality of output devices and a second summarized presentation in the plurality of presentations with a head up display (HUD) in the plurality of output devices in response to detection of a heavy traffic level around the motor vehicle.

9. The method of claim 7, the generation of the output of the plurality of summarized presentations further comprising:

generating the output of the plurality of summarized presentations with an LCD panel video output device in the plurality of output devices in response to detection that the motor vehicle is halted.

10. The method of claim 7, further comprising:

generating with the processor one summarized presentation in the plurality of summarized presentations including a plurality of summarized sets of data corresponding to a plurality of relevance levels;

setting with the processor a relevance threshold with reference to the data corresponding to at least one of the level of traffic around the motor vehicle and the motion of the motor vehicle; and

generating with the processor the output of the one summarized presentation including only a portion of the plurality of summarized sets of data corresponding to a relevance level that exceeds the relevance threshold.

11. The method of claim 7 further comprising:

receiving with an input device input from the user during generation of the plurality of summarized outputs with the output device; and

adjusting with the processor the predetermined format of the plurality of summarized outputs with reference to the input from the user.

12. The method of claim 11 further comprising:

truncating with the processor the output of one summarized presentation in the plurality of summarized presentations in response to the input from the user; and

beginning output of another summarized presentation in the plurality of summarized presentations with the processor in response to the input from the user.