Method and Apparatus for Speech Interaction with Children

• US 20180277117A1
• Filed: 03/26/2018
• Published: 09/27/2018
• Est. Priority Date: 03/23/2017
• Status: Active Grant

• Current Assignee: Hello Clover, LLC
• Original Assignee: Hello Clover, LLC
• Inventors: HERGENROEDER, Alex Lauren
• Granted Patent: US 10,957,325 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/178 estimating age from face image; using age information for improving recognition
• CPC Class Codes: G09B 19/04 Speaking with audible presentation of the material to be studied G09B5/04
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 25/48 specially adapted for particular use

Abstract

A method and apparatus for performing speech interaction with children is provided. The apparatus may be a computing device that includes at least one camera, at least one microphone, memory, and at least one processor for executing stored instructions. The at least one processor may be configured to determine an age range or an age or skill level of the child. The computing device may receive one or more inputs from the child. The at least one processor may perform analysis on the one or more inputs based at least in part on the determined age range or the age or the skill level of the child, and output a speech response to the child based on the performed analysis.

Claims

1. A computing device for speech interaction with a child, the computing device comprising:

at least one camera;

at least one microphone; and

at least one processor for executing stored instructions to;

determine an age range or age or skill level of the child,

receive one or more inputs from the child via the at least one camera and/or the at least one microphone,

perform analysis on the one or more inputs based at least in part on the determined age range or the age or the skill level of the child so as to interpret communication from the child, and

output a speech response to the child based on the performed analysis.

2. The computing device of claim 1, wherein the age range or the age or the skill level of the child is provided by a parent of the child.

3. The computing device of claim 1, wherein the age range or the age or the skill level of the child is determined based on real-time data acquired by the at least one camera and/or the at least one microphone and/or based on existing data associated with the child.

4. The computing device of claim 3, wherein the real-time data includes one or more images of the child and/or one or more sounds from the child, and the determination of the age range or the age of the child further includes analyzing the one or more images and/or the one or more sounds.

5. The computing device of claim 3, wherein the existing data includes purchase history of a plurality of items associated with the child.

6. The computing device of claim 1, wherein the one or more inputs from the child includes one or more of the following:

(i) a verbal input and (ii) a visual input.

7. The computing device of claim 6, wherein the verbal input includes one or more of the following:

(i) a sound input, (ii) a vocalization input, (iii) a pronunciation input, (iv) a speech input, (v) a word input, (vi) a phrase input, or (vii) babbling input.

8. The computing device of claim 6, wherein the visual input includes one or more of the following:

(i) a gesture input and (ii) an object input.

9. The computing device of claim 1, wherein the analysis on the one or more inputs includes analysis of one or more of the following:

(i) speech sound development information for children at varying ages, (ii) articulation development information for children at varying ages, (iii) common phonological processes for children at varying ages, and (iv) common speech or sound errors that children make at varying ages.

10. The computing device of claim 1, wherein the analysis on the one or more inputs includes analysis of learned speech interaction between the child and a parent of the child.

11. The computing device of claim 10, wherein the learned speech interaction includes:

(i) prior association of a sound by the child and an object and/or (ii) pitch or tones associated with a sound unique to the child.

12. The computing device of claim 1, wherein the analysis on the one or more inputs includes analysis of learned speech interaction between the child and the computing device.

13. The computing device of claim 1, wherein the analysis on the one or more inputs includes identification of babbling by the child.

14. The computing device of claim 6, wherein the analysis on the one or more inputs includes contextual analysis on the verbal input and the visual input.

15. The computing device of claim 14, wherein the contextual analysis includes determining whether there is an association between the verbal input and the visual input.

16. The computing device of claim 1, wherein the speech response to the child is output in motherese.

17. The computing device of claim 1, wherein the speech response to the child is output in character voice.

18. The computing device of claim 1, wherein the speech response to the child is output to mimic voice and speech characteristics of a parent of the child.

19. A method for speech interaction with a child, the method comprising:

determining, by a computing device, an age range or age or skill level of the child;

receiving, by at least one camera and/or at least one microphone, one or more inputs from the child;

performing, by the computing device, analysis on the one or more inputs based at least in part on the determined age range or the age or the skill level of the child so as to interpret communication from the child; and

outputting, by the computing device, a speech response to the child based on the performed analysis.

20. A non-transitory computer readable medium storing executable instructions, the executable instructions when executed by at least one processor performs a method for speech interaction with a child, the method comprising:

determining an age range or age or skill level of the child;

receiving, by at least one camera and/or at least one microphone, one or more inputs from the child;

performing analysis on the one or more inputs based at least in part on the determined age range or the age or the skill level of the child so as to interpret communication from the child; and

outputting a speech response to the child based on the performed analysis.