Intelligent and context aware reading systems

• US 10,360,254 B1
• Filed: 03/22/2017
• Issued: 07/23/2019
• Est. Priority Date: 03/24/2016
• Status: Active Grant

• Current Assignee: Massachusetts Mutual Life Insurance Company
• Original Assignee: Massachusetts Mutual Life Insurance Company
• Inventors: Knas, Michal, John, Jiby
• Primary Examiner(s): Pham, Tuan A
• Application Number:
  US15/466,410
• Time in Patent Office: 853 Days
• Field of Search: None
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/437 Administration of user profiles, e.g. generation, initialisation, adaptation, distribution
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters

Abstract

Methods and systems for supplying content to a user including generating, configuring content data for presentation on a display of a user computing device, transmitting the content data to the display of the user computing device for display on the user computing device, collecting, behavior data of the user sensed by the tracking module, generating engagement data based on the collected behavior data, determining supplemental content configured for presentation on a display of the user computing device and displaying the supplemental content to the user on the user computing device.

Claims

1. A method comprising:

generating, by a content processing module of a server, content data for display on a first portion of a user interface of a user computing device;

transmitting, by the content processing module, the content data to the user computing device for display on the first portion of the user interface;

upon display of the content data on the first portion of the user interface, executing, by a tracking module of the server, an instruction to activate a tracking sensor communicatively coupled with the user computing device;

automatically extracting, by the tracking module, behavior data of a user sensed by the tracking sensor while the user views the content data, wherein the behavior data comprises at least eye gaze and line of sight of the user directed towards the content data displayed on the first portion of the user interface, wherein the tracking sensor includes at least an eye tracking sensor that extracts information about an eye movement of the user and duration of the user'"'"'s eye movement outside of a boundary associated with the first portion of the user interface;

dynamically determining, by the content processing module, supplemental content data in response to processing of information associated with at least the eye gaze, the line of sight, and the content data, wherein the supplemental content data comprises content information associated with at least a portion of the content data; and

automatically activating, by the content processing module, a hyperlink on the first portion of the user interface for display of the supplemental content data on a second portion of the user interface.

2. The method according to claim 1, wherein collecting the behavior data further comprises automatically extracting the behavior data from the user captured using a head-tracking sensor or an expression processing sensor, wherein the head-tracking sensor or the expression processing sensor is communicatively coupled to the user computing device.

3. The method according to claim 2, wherein the tracking sensor is an head-tracking sensor which extracts information about a head movement of the user and duration of the head movement in a direction outside of a boundary associated with one or more portions of the displayed content data.

4. The method according to claim 2 wherein the tracking sensor is an expression processing sensor which extracts information about an expression of the user and duration of the expression within a boundary associated with one or more portions of the displayed content data.

5. The method according to claim 1, wherein the behavior data includes information characterizing an interest of the user in one or more portions of the content data displayed on the user computing device as interested, confused, or indifferent.

6. The method according to claim 1, wherein the supplemental content data includes the content information related to at least a definition of a term within the content data.

7. A system comprising:

a user computing device comprising a user interface;

a communications network; and

a processing module of a server configured to;

generate content data for display on a first portion of the user interface;

transmit the content data to the user computing device for display on the first portion of the user interface;

upon display of the content data on the first portion of the user interface, execute an instruction to activate a tracking sensor communicatively coupled with the user computing device;

automatically extract behavior data of a user sensed by the tracking sensor while the user views the content data, wherein the behavior data comprises at least eye gaze and line of sight of the user directed towards the content data displayed on the first portion of the user interface, wherein the tracking sensor includes at least an eye tracking sensor that extracts information about an eye movement of the user and duration of the user'"'"'s eye movement outside of a boundary associated with the first portion of the user interface;

dynamically determine supplemental content data in response to processing of information associated with at least the eye gaze, the line of sight, and the content data, wherein the supplemental content data comprises content information associated with at least a portion of the content data; and

automatically activate a hyperlink on the first portion of the user interface for display of the supplemental content data on a second portion of the user interface.

8. The system of claim 7, further comprising an external data source that stores the supplemental content data.

9. The system of claim 7, wherein the tracking sensor is associated with the user computing device.

10. The system of claim 9, wherein the processing module is located in the server, and the server communicates with the user computing device via a first communication network.

11. The system of claim 10, further comprising an external data source, wherein the server communicates with the external data source via a second communication network.