Simple affirmative response operating system

• US 10,115,398 B1
• Filed: 06/08/2018
• Issued: 10/30/2018
• Est. Priority Date: 07/07/2016
• Status: Active Grant

• Current Assignee: Intelligently Interactive, Inc.
• Original Assignee: Intelligently Interactive, Inc.
• Inventors: Weingartner, Eric H.
• Primary Examiner(s): Neway, Samuel G
• Application Number:
  US16/004,127
• Publication Number:
  US 20180293985A1
• Time in Patent Office: 144 Days
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04L 12/2816 Controlling appliance services of a home automation network by calling their functionalities arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station; in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00
• CPC Class Codes: H04L 12/2827 Reporting to a device within the home network; wherein the reception of the information reported automatically triggers the execution of a home appliance functionality
• CPC Class Codes: H04L 51/02 using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]

Abstract

A simple affirmative response operating system is disclosed for selecting a data item from a list of options using a unique affirmative action. Text-based labels in a listing of content are converted to speech using an embedded text-to-speech engine and an audio output of a first converted label is provided. A listening state is entered into for a predefined pause time to await receipt of the simple affirmative action. If the simple affirmative action is performed during the predefined pause time, an associated content item is selected for output. If the simple affirmative action is not performed during the predefined pause time, an audio output of a next converted label in the list is provided. This protocol may be used to control a variety of computing devices safely and efficiently while a user is distracted or disabled from using traditional input methods.

Claims

1. A system, comprising:

a processor;

a sensor coupled to the processor;

an electronic sensory presentation device; and

non-transitory memory storing;

an identification of a single, unique, system-wide, and context-independent affirmative action for use in modifying system parameters, selecting options, and selecting items of content;

system parameters, wherein each system parameter is associated with an identifier from a sequence of system parameter identifiers;

options, wherein each option is part of a list of possible commands or navigation options, and wherein each option is associated with an identifier from a sequence of option identifiers; and

instructions that, when executed by the processor, cause the processor to;

store the items of content, wherein each item of content comprises a webpage, a book, an article, a text-based communication, an event stored in a calendar system, an audio file, or a video file, and is not one of the options or the system parameters;

store a sequence of identifiers of content, wherein each identifier of the sequence of identifiers of content is associated with an item of content;

enter a first list-pause cycle comprising;

a first list-pause that comprises;

 

outputting, via the sensory presentation device, an identifier from the sequence of identifiers of content; and

 

pausing a predetermined length of time;

repeating the first list-pause, each repetition of the first list-pause outputting a different next identifier from the sequence of identifiers of content, until determining, via input from the sensor, that the affirmative action has been performed during the pause of a most recent first list-pause; and

responsive to determining that the affirmative action has been performed during the pause of the most recent list-pause, outputting, via the sensory presentation device, an item of content associated with the identifier output during that most recent first list-pause;

enter a second list-pause cycle comprising;

a second list-pause comprising;

 

outputting, via the sensory presentation device, an identifier from the sequence of option identifiers; and

 

pausing a predetermined length of time;

 

repeating the second list-pause, each repetition of the second list-pause outputting a different next identifier from the sequence of option identifiers, until determining, via input from the sensor, that the single unique affirmative action has been performed during the pause of a most recent second list-pause; and

 

responsive to determining that the affirmative action has been performed during the pause of the most recent second list-pause, either navigating to an application mode or performing a command based on the option associated with the identifier output during that most recent second list-pause; and

enter a third list-pause cycle comprising;

a third list-pause comprising;

 

outputting, via the sensory presentation device, an identifier from the sequence of system parameter identifiers; and

 

pausing a predetermined length of time;

repeating the third list-pause, each repetition of the third list-pause outputting a different next identifier from the sequence of system parameter identifiers, until determining, via input from the sensor, that the single unique affirmative action has been performed during the pause of a most recent third list-pause; and

responsive to determining that the affirmative action has been performed during the pause of the most recent third list-pause, modifying the system parameter associated with the identifier output during that most recent third list-pause.

2. The system of claim 1, wherein the non-transitory memory further stores:

an identification of a unique, system-wide, and context-independent pause-initiation action; and

instructions that, when executed by the processor, further cause the processor to;

responsive to determining that the pause-initiation action has been performed during a pause of the first, second, or third list-pause, terminate repetition of list-pauses and enter a wait-pause mode.

3. The system of claim 2, wherein the non-transitory memory further stores:

an identification of a unique, system-wide, and context-independent options-initiation action; and

instructions that, when executed by the processor, further cause the processor to;

responsive to determining that the options-initiation action has been performed during either a list-pause cycle or the wait-pause mode, enter the second list-pause cycle.

4. The system of claim 1, wherein the electronic sensory presentation device is a speaker, and wherein each of the first, second, and third list-pauses further comprises, after outputting an identifier and before pausing the predetermined length of time, outputting, via the speaker, an audio signifier that a pause is beginning.

5. The system of claim 1, wherein the electronic sensory presentation device is a speaker, and wherein each of the first, second, and third list-pauses further comprise, after pausing the predetermined length of time, outputting, via the speaker, an audio signifier that the predetermined length of time has elapsed and a new list-pause will begin.

6. The system of claim 1, wherein the electronic sensory presentation device is a speaker, wherein at least one item of content comprises textual data, and wherein outputting the item of content comprises converting the content with a text-to-speech engine and playing the converted item of content.

7. The system of claim 6, wherein the textual data is received from a search engine, the sequence of identifiers of content is a sequence of webpage titles, and the items of content comprise a plurality of webpage contents.

8. The system of claim 1, wherein the sensor coupled to the processor is one of:

a microphone, a camera, or an accelerometer.

9. The system of claim 1, wherein the electronic sensory presentation device is a speaker or a video screen.

10. A computer-implemented method for interaction between a human and a computing device, comprising:

storing an identification of a single, unique, system-wide, and context-independent affirmative action for use in modifying system parameters, selecting options, and selecting items of content;

storing a sequence of system parameters, and a sequence of system parameter identifiers, wherein each identifier from the sequence of system parameter identifiers is associated with a system parameter from the sequence of system parameters;

storing a sequence of options, wherein each option is part of a list of possible commands or navigation options, and a sequence of option identifiers, wherein each identifier from the sequence of option identifiers is associated with an option from the sequence of options;

storing a sequence of items of content and a sequence of identifiers of items of content, wherein each identifier of the sequence of identifiers of items of content is associated with an item of content from the sequence of items of content, and wherein each item of content comprises a webpage, a book, an article, a text-based communication, an event stored in a calendar system, an audio file, or a video file, and is not an option from the sequence of options or a system parameter from the sequence of system parameters;

entering a first list-pause cycle comprising;

a first list-pause that comprises;

outputting, via the computing device, an identifier from the sequence of identifiers of items of content; and

pausing a predetermined length of time;

repeating the first list-pause, each repetition of the first list-pause outputting a different next identifier from the sequence of identifiers of items of content, until determining the affirmative action has been performed during the pause of a most recent first list-pause; and

responsive to determining the affirmative action has been performed during the pause of the most recent first list-pause, outputting, via the computing device, the item of content from the sequence of items of content associated with the identifier output during that most recent first list-pause;

entering a second list-pause cycle comprising;

a second list-pause comprising;

outputting, via the sensory presentation device, an identifier from the sequence of option identifiers; and

pausing a predetermined length of time;

repeating the second list-pause, each repetition of the second list-pause outputting a different next identifier from the sequence of option identifiers, until determining that the single unique affirmative action has been performed during the pause of a most recent second list-pause; and

responsive to determining that the affirmative action has been performed during the pause of the most recent second list-pause, either navigating to an application mode or performing a command based on the option from the sequence of options associated with the identifier output during that most recent second list-pause; and

entering a third list-pause cycle comprising;

a third list-pause comprising;

outputting, via the sensory presentation device, an identifier from the sequence of system parameter identifiers; and

pausing a predetermined length of time;

repeating the third list-pause, each repetition of the third list-pause outputting a different next identifier from the sequence of system parameter identifiers, until determining that the single unique affirmative action has been performed during the pause of a most recent third list-pause; and

responsive to determining that the affirmative action has been performed during the pause of the most recent third list-pause, modifying the system parameter associated with the identifier output during that most recent third list-pause.

11. The method of claim 10, further comprising:

storing an identification of a unique, system-wide, and context-independent pause-initiation action; and

responsive to determining that the pause-initiation action has been performed during a pause of the first, second, or third list-pause, terminating repetition of list-pauses and entering a wait-pause mode.

12. The method of claim 11, further comprising:

storing an identification of a unique, system-wide, and context-independent options-initiation action; and

responsive to determining that the options-initiation action has been performed during either a list-pause cycle or the wait-pause mode, entering the second list-pause cycle.

13. The method of claim 10, wherein each of the first, second, and third list-pauses further comprises, after outputting an identifier and before pausing the predetermined length of time, outputting an audio signifier that a pause is beginning.

14. The method of claim 10, wherein each of the first, second, and third list-pauses further comprises, after pausing the predetermined length of time, outputting an audio signifier that the predetermined length of time has elapsed and a new list-pause will begin.

15. The method of claim 10, wherein an item of content comprises textual data, and wherein outputting the item of content comprises converting the item of content with a text-to-speech engine and playing the converted item of content.

16. The method of claim 15, wherein the textual data is received from a search engine, the sequence of identifiers is a sequence of webpage titles, and the items of content comprise a plurality of webpage contents.

17. The method of claim 10, wherein the affirmative action is sensed by one of:

a microphone, a camera, or an accelerometer.

18. The method of claim 10, wherein an item of content is output via a speaker or a video screen.