Human-digital media interaction tracking

• US 10,327,690 B2
• Filed: 07/24/2017
• Issued: 06/25/2019
• Est. Priority Date: 09/23/2008
• Status: Active Grant

• Current Assignee: Clinical Ink, Inc.
• Original Assignee: Digital Artefacts, LLC (Clinical Ink, Inc.)
• Inventors: Severson, Joan
• Primary Examiner(s): Layno, Carl H
• Assistant Examiner(s): Pahakis, Manolis
• Application Number:
  US15/658,003
• Publication Number:
  US 20170319124A1
• Time in Patent Office: 701 Days
• Field of Search: None
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 19/22 Games, e.g. card games
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 20/70 relating to mental therapies, e.g. psychological therapy or autogenous training
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS

Abstract

A system for human-digital media interaction tracking. One example system includes a database that stores information regarding a user'"'"'s activity history for various different cognitive tasks, and a computing device that receives user behavior information indicating usage by a user of an interactive software program, the interactive software program associated with at least one of the cognitive tasks. The computing device, in response to the receipt of user behavior information indicating usage by the user of the interactive software program, updates the database information regarding the user'"'"'s activity history for the at least one of the cognitive tasks.

Claims

1. A system for cognitive training based on user-digital media interaction tracking, comprising:

a plurality of computing devices having a plurality of commercially available third-party interactive digital media stored therein, said digital media including a video game and a web browser, each of the plurality of computing devices including;

a processor and a memory, the memory including;

one or more of the plurality of digital media in the form of executable software programs;

a user-digital media interaction monitor configured to plug-in as a monitoring extension to each of the digital media without modification of interactive content of said digital media, the user-digital media interaction monitor having executable instructions that configure the computing device to;

identify a user identity for the user; and

unobtrusively track the user-digital media interaction, which includes a speed and duration of active interaction of the user with each of the plurality of digital media; and

a computer server with a processor and a memory, the memory including;

a database having a first predetermined weighted mapping between each of the plurality of digital media with one or more of a plurality of cognitive tasks, and a second predetermined weighted mapping between each of the plurality of cognitive tasks with one or more of a plurality of brain areas, wherein the plurality of cognitive tasks include at least two of memory, attention, motor function, visual search, decision making, inhibitory control, computation and speed of processing; and

executable instructions that configure the computer server to;

perform an analysis that determines a duration of exercise of each of the plurality of cognitive tasks and brain areas for the user based on the first predetermined weighted mapping, the second predetermined weighted mapping and a history for a period of time of the user-digital media interaction across the plurality of the computing devices; and

determine a plan of cognitive exercise of one or more of the plurality of cognitive tasks and one or more of the plurality of brain areas for the user, the plan including a schedule with a recommended duration of user-digital media interaction with one or more of the plurality of digital media; and

serve the plan to at least one of the computing devices;

wherein each of the computing devices are further configured to receive and display the plan.

2. The system of claim 1, wherein the memory of one of the computing devices further includes executable instructions that configure the one of the computing devices to perform a computing device specific analysis of a history of device specific user-digital media interaction on the one of the computing devices.

3. The system of claim 1, wherein the analysis further comprises at least one of:

analyzing the user-digital media interaction to produce charts, graphs, illustrations, or animations, generating recommendations for the user of an additional executable interactive software program associated with an additional cognitive task, evaluating the user'"'"'s cognitive functions, diagnosing a deficiency in the user'"'"'s cognitive functions, generating a plan for remediation therapy to address a deficiency in the user'"'"'s cognitive functions, and correlating the user-digital media interaction history with physical location data.

4. The system of claim 1, wherein the memory of one of the computing devices further includes a history of device specific user-digital media interaction on the one of the computing devices.

5. The system of claim 1, wherein the first and second mappings are based on electroencephalography (EEG) data.

6. The system of claim 5, wherein the digital media further include a text messaging application, and the brain area includes at least one of left frontal lobe, left parietal lobe, temporal lobe, occipital lobe, right frontal lobe, and right parietal lobe.

7. The system of claim 1, wherein the digital media further include a text messaging application.

8. The system of claim 1, wherein the user-digital media interaction includes passive interaction.

9. The system of claim 8, wherein the plan is determined based on both of the active interaction and the passive interaction.

10. The system of claim 9, wherein the plan is determined based on a time an e-book is loaded and a frequency of turning a page.

11. A method for cognitive training based on user-digital media interaction tracking, comprising:

storing a plurality of commercially available third-party interactive digital media on a plurality of computing devices, each of which include a processor and a memory, said digital media including a video game and a web-browser, wherein the respective memory of each of the plurality of computing devices includes;

one or more of the plurality of digital media in the form of executable software programs; and

a user-digital media interaction monitor configured to plug-in as a monitoring extension to each of the digital media without modification of interactive content of said digital media, the user-digital media interaction monitor having executable instructions that configure a respective computing device to;

identify a user identity for the user; and

unobtrusively track the user-digital media interaction, which includes a speed and duration of active interaction of the user with each of the plurality of digital media; and

identifying, by the user-digital media interaction monitor, the user identity for the user;

unobtrusively tracking the user-digital media interaction, including tracking at least the speed and the duration of active interaction of the user;

transmitting, from the plurality of computing devices, a history for a period of time of the user-digital media interaction to a server including a database having a first predetermined weighted mapping between each of the plurality of digital media with one or more of a plurality of cognitive tasks, and a second predetermined weighted mapping between each of the plurality of cognitive tasks with one or more of a plurality of brain areas, wherein the plurality of cognitive tasks include at least two of memory, attention, motor function, visual search, decision making, inhibitory control, computation and speed of processing, wherein the computer server is configured to;

perform an analysis that determines a duration of exercise of each of the plurality of cognitive tasks and brain areas for the user based on the first predetermined weighted mapping, the second predetermined weighted mapping and the history for the period of time of the user-digital media interaction across the plurality of the computing devices; and

determine a plan of cognitive exercise of one or more of the plurality of cognitive tasks and one or more of the plurality of brain areas for the user, the plan including a schedule with a recommended duration of user-digital media interaction with one or more of the plurality of digital media; and

receiving, from the computer server, the plan in at least one of the computing devices; and

displaying the plan on the at least one of the computing devices.

12. A method for cognitive training based on user-digital media interaction tracking, comprising:

storing, in a memory of a computer server, a database having a first predetermined weighted mapping between each of a plurality of digital media with one or more of a plurality of cognitive tasks, and a second predetermined weighted mapping between each of the plurality of cognitive tasks with one or more of a plurality of brain areas, wherein the plurality of cognitive tasks include at least two of memory, attention, motor function, visual search, decision making, inhibitory control, computation and speed of processing;

receiving, from a plurality of computing devices associated with a user identity for a user, a history for a period of time of user-digital media interaction, wherein the plurality of computing devices have a plurality of commercially available third-party interactive digital media stored therein, said digital media including a video game and a web-browser, wherein a respective memory of each of the plurality of computing devices includes;

one or more of the plurality of digital media in the form of executable software programs; and

a user-digital media interaction monitor configured to plug-in as a monitoring extension to each of the digital media without modification of interactive content of said digital media, the user-digital media interaction monitor having executable instructions that configure a respective computing device to;

identify a user identity for the user; and

unobtrusively track the user-digital media interaction, which includes a speed and duration of active interaction of the user with each of the plurality of digital media;

performing, by a processor of the computer server, an analysis that determines a duration of exercise of each of the plurality of cognitive tasks and brain areas for the user based on the first predetermined weighted mapping, the second predetermined weighted mapping and the history for the period of time of the user-digital media interaction across the plurality of the computing devices;

determining, by the processor of the computer server, a plan of cognitive exercise of one or more of the plurality of cognitive tasks and one or more of the plurality of brain areas for the user, the plan including a schedule with a recommended duration of user-digital media interaction with one or more of the plurality of digital media; and

serving, by the computer server, the plan to at least one of the computing devices, wherein each of the computing devices are further configured to receive and display the plan.