System and Method for Dialog-Enabled Context-Dependent and User-Centric Content Presentation

• US 20160313868A1
• Filed: 12/11/2014
• Published: 10/27/2016
• Est. Priority Date: 12/20/2013
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Liu, Fel, Weng, Fuliang, Xu, Kui, Zhao, Lin, Feng, Zhe, Shen, Zhongnan
• Granted Patent: US 10,209,853 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/148 Instrument input by voice
• CPC Class Codes: B60K 2360/1868 according to driving situations
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/654 the user being the driver
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

An in-vehicle infotainment system, smart home information access and device control unit, or mobile system presents summarized information to a user based on a user preference model that is associated with the user. The system modifies the presentation of information to the user based on environmental context data about the vehicle and user context data about the activity of the user. During presentation of the information, the system modifies the content and presentation of the summarized information in response to multi-modal input requests from the user.

Claims

1. A content presentation system comprising:

a network device configured to retrieve information from a plurality of information sources through a data network;

a memory configured to store a user preference model corresponding to a user of the content presentation system;

an output device; and

a processor operatively connected to the network device, the memory, and the output device, the processor being configured to;

retrieve information from the plurality of information sources corresponding to a plurality of predetermined topics with reference to the user preference model;

generate a plurality of summarized presentations of the information for each topic in the plurality of topics; and

generate an output with the output device for each of the plurality of summarized presentations for the plurality of topics with the output device in a predetermined format for the user with reference to the user preference model.

2. The content presentation system of claim 1 further comprising:

an environment sensor configured to generate data corresponding to an environment around the content presentation system; and

the processor being operatively connected to the environment sensor and further configured to;

modify the output of the plurality of summarized presentations with reference to the data corresponding to the environment around the presentation system.

3. The content presentation system of claim 2, the processor being further configured to:

generate the output of the at least one of the plurality of summarized presentations with an audio output device with reference to the data corresponding to the environment around the presentation system.

4. The content presentation system of claim 2, the processor being further configured to:

generate the output of the at least one of the plurality of summarized presentations with a video output device with reference to the data corresponding to the environment around the presentation system.

5. The content presentation system of claim 2, the processor being further configured to:

generate one summarized presentation in the plurality of summarized presentations including a plurality of summarized sets of data corresponding to a plurality of relevance levels;

set a relevance threshold with reference to the data corresponding to the environment around the presentation system; and

generate the output of the one summarized presentation including only a portion of the plurality of summarized sets of data corresponding to a relevance level that exceeds the relevance threshold.

6. The content presentation system of claim 1 further comprising:

an input device configured to receive input from the user; and

the processor being operatively connected to the input device and further configured to;

receive the input from the user with the user input device during generation of the plurality of summarized outputs with the output device; and

adjust the predetermined format of the plurality of summarized outputs with reference to the input from the user.

7. The content presentation system of claim 6, the processor being further configured to:

truncate the output of one summarized presentation in the plurality of summarized presentations in response to the input from the user; and

begin output of another summarized presentation in the plurality of summarized presentations in response to the input from the user.

8. The content presentation system of claim 6, the processor being further configured to:

generate additional detail for one summarized presentation in the plurality of summarized presentations in response to the input from the user; and

generate the output of the one summarized presentation with the additional detail with the output device.

9. The content presentation system of claim 1, the processor being further configured to:

identify a viewpoint preference corresponding to one topic in the plurality of topics with reference to the user preference model stored in the memory; and

filter the information from the plurality of information sources to select only information sources that correspond to the viewpoint preference for generation of the summarized presentation corresponding to the one topic with reference to the user preference model.

10. The content presentation system of claim 9, the processor being further configured to:

identify a viewpoint associated with each of the plurality of information sources corresponding to the one topic with reference to an ontology associated with the one topic.

11. A method of presenting content in a content presentation system comprising:

retrieving with a network device information from a plurality of information sources corresponding to a plurality of predetermined topics with reference to a user preference model stored in a memory;

generating with a processor a plurality of summarized presentations of the information for each topic in the plurality of topics; and

generating with the processor an output for each of the plurality of summarized presentations for the plurality of topics with an output device in a predetermined format for a user with reference to the user preference model.

12. The method of claim 11 further comprising:

receiving with an environment sensor data corresponding to an environment around the content presentation system; and

modifying with the processor an output of the plurality of summarized presentations with reference to the data corresponding to the environment around the presentation system.

15. The method of claim 12 further comprising:

generating with the processor one summarized presentation in the plurality of summarized presentations including a plurality of summarized sets of data corresponding to a plurality of relevance levels;

setting with the processor a relevance threshold with reference to the data corresponding to the environment around the presentation system; and

generating with the processor the output of the one summarized presentation including only a portion of the plurality of summarized sets of data corresponding to a relevance level that exceeds the relevance threshold.

16. The method of claim 11 further comprising:

an input device configured to receive input from the user; and

the processor being operatively connected to the input device and further configured to;

receiving with an input device input from the user during generation of the plurality of summarized outputs with the output device; and

adjusting with the processor the predetermined format of the plurality of summarized outputs with reference to the input from the user.

17. The method of claim 16 further comprising:

truncating with the processor the output of one summarized presentation in the plurality of summarized presentations in response to the input from the user; and

beginning output of another summarized presentation in the plurality of summarized presentations with the processor in response to the input from the user.

18. The method of claim 16 further comprising:

generating with the processor additional detail for one summarized presentation in the plurality of summarized presentations in response to the input from the user; and

generating with the processor the output of the one summarized presentation with the additional detail with the output device.

19. The method of claim 11 further comprising:

identifying with the processor a viewpoint preference corresponding to one topic in the plurality of topics with reference to the user preference model stored in the memory; and

filtering with the processor the information from the plurality of information sources to select only information sources that correspond to the viewpoint preference for generation of the summarized presentation corresponding to the one topic with reference to the user preference model.

20. The method of claim 19 further comprising:

identifying with the processor a viewpoint associated with each of the plurality of information sources corresponding to the one topic with reference to an ontology associated with the one topic.

13. The method of 12, the modification of the output of the plurality of summarized presentations further comprising:

generating the output of the at least one of the plurality of summarized presentations with an audio output device with reference to the data corresponding to the environment around the presentation system.

14. The method of 12, the modification of the output of the plurality of summarized presentations further comprising:

generating the output of the at least one of the plurality of summarized presentations with a video output device with reference to the data corresponding to the environment around the presentation system.