ELECTRONIC DEVICE AND METHOD FOR INTERPRETING BABY LANGUAGE

• US 20170154630A1
• Filed: 04/01/2016
• Published: 06/01/2017
• Est. Priority Date: 11/27/2015
• Status: Abandoned Application

• Current Assignee: Futaihua Industry (Shenzhen) Co., Ltd. (Hon Hai Precision Industry Co., Ltd.), Hon Hai Precision Industry Co., Ltd.
• Original Assignee: Futaihua Industry (Shenzhen) Co., Ltd. (Hon Hai Precision Industry Co., Ltd.), Hon Hai Precision Industry Co., Ltd.
• Inventors: ZHANG, YU
• Application Number:
  US15/088,660
• Publication Number:
  US 20170154630A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06F 40/56 Natural language generation
• CPC Class Codes: G06V 30/274 Syntactic or semantic context, e.g. balancing
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G10L 25/51 for comparison or discrimination

Abstract

In a baby language interpreting method, baby language from a baby is received; environment information of an environment where the baby is located upon receipt of the baby language is captured. The baby language information is recognized from the received baby language. The environment information is recognized. The recognized baby language information and the recognized environment information are compared to predefined baby language information and predefined environment information recorded in a predefined relationship table. The received baby language is interpreted into the semantic information described in adult language according to a comparison result. The interpreted semantic information described in adult language is presented to an adult user.

Claims

1. A method for interpreting baby language being executed by at least one processor of an electronic device, the method comprising:

receiving, via a sound receiving device of the electronic device, baby language from a baby;

capturing, upon receipt of the baby language, via an environment capture device of the electronic device, environment information of an environment where the baby is located;

recognizing, via the at least one processor, baby language information from the received baby language;

recognizing, via the at least one processor, the captured environment information of the environment;

comparing, via the at least one processor, the recognized baby language information and the recognized environment information to predefined baby language information and predefined environment information recorded in a predefined relationship table, wherein the relationship table records predefined semantic information described in adult language, and each piece of information of the semantic information is associated with a combination of one piece of information of the baby language information and one piece of information of the environment information;

interpreting, via the at least one processor, the received baby language into the semantic information described in adult language according to a comparison result; and

presenting, via the at least one processor, the interpreted semantic information described in adult language to an adult user.

2. The method according to claim 1, further comprising:

marking the recognized baby language information with baby language keywords.

3. The method according to claim 1, further comprising:

marking the recognized environment information with environment keywords.

4. The method according to claim 1, wherein the relationship table further records predefined baby body language information, and each piece of information of the semantic information is associated with a combination of one piece of information of the baby language information, one piece of information of the environment information, and one piece of information of the baby body language information.

5. The method according to claim 4, further comprising:

capturing, via an image capture device of the electronic device, body images of the baby upon receipt of the baby language;

recognizing, via the at least one processor, the baby body language information from the captured body images;

comparing, via the at least one processor, the recognized baby body language information to the baby body language information of the relationship table; and

interpreting, via the at least one processor, the received baby language into the semantic information described in adult language according to a comparison result of the baby body language information.

6. The method according to claim 4, further comprising:

creating the predefined relationship table in response to user operations.

7. The method according to claim 1, further comprising:

receiving, via a sound receiving device of the electronic device, environment sound of the environment where the baby is located upon receipt of the baby language;

recognizing, via the at least one processor, the environment information from the received environment sound.

8. The method according to claim 7, wherein the recognized environment information is marked with environment keywords.

9. The method according to claim 1, wherein the environment information comprises information from environment image and/or information from environment sound, and “

capturing, via an environment capture device of the electronic device, environment information of an environment where the baby is located upon receipt of the baby language”

comprises;

capturing images and/or receiving sound of the environment where the baby is located upon receipt of the baby language.

10. An electronic device comprising:

a sound receiving device, for receiving baby language from a baby;

an environment capture device, for capturing, upon receipt of the baby language, environment information of an environment where the baby is located;

a processor; and

a storage device that stores one or more programs which, when executed by the processor, cause the processor to;

recognize, via the processor, baby language information from the received baby language;

recognize, via the processor, the captured environment information of the environment;

compare, via the processor, the recognized baby language information and the recognized environment information to predefined baby language information and predefined environment information recorded in a predefined relationship table, wherein the relationship table records predefined semantic information described in adult language, and each piece of information of the semantic information is associated with a combination of one piece of information of the baby language information and one piece of information of the environment information;

interpret, via the processor, the received baby language into the semantic information described in adult language according to a comparison result; and

present, via the processor, the interpreted semantic information described in adult language to an adult user.

11. The electronic device according to claim 10, wherein the recognized baby language information is marked with baby language keywords.

12. The electronic device according to claim 10, wherein the recognized environment information is marked with environment keywords.

13. The electronic device according to claim 10, wherein the relationship table further records predefined baby body language information, and each piece of information of the semantic information is associated with a combination of one piece of information of the baby language information, one piece of information of the environment information, and one piece of information of the baby body language information.

14. The electronic device according to claim 13, further comprising an image capture device, wherein the image capture device captures body images of the baby upon receipt of the baby language;

and the processor is further caused to;

recognize baby body language information from the captured body images;

compare the recognized baby body language information with the baby body language information of the relationship table; and

interpret the received baby language into the semantic information described in adult language according to a comparison result of the baby body language information.

15. The electronic device according to claim 10, wherein the sound receiving device receives sound of the surrounding environment where the baby is located upon receipt of the baby language;

and the processor is caused to recognize the environment information from the received environment sound.

16. A non-transitory storage medium having stored thereon instructions that, when executed by a processor of an electronic device, causes the processor to perform a method for interpreting baby language, wherein the method comprises:

receiving, via a sound receiving device of the electronic device, baby language from a baby;

capturing, upon receipt of the baby language, via an environment capture device of the electronic device, environment information of an environment where the baby is located upon receipt of the baby language;

recognizing, via the at least one processor, baby language information from the received baby language;

recognizing, via the at least one processor, the captured environment information of the environment;

comparing, via the at least one processor, the recognized baby language information and the recognized environment information to predefined baby language information and predefined environment information recorded in a predefined relationship table, wherein the relationship table records predefined semantic information described in adult language, and each piece of information of the semantic information is associated with a combination of one piece of information of the baby language information and one piece of information of the environment information;

interpreting, via the at least one processor, the received baby language into the semantic information described in adult language according to a comparison result; and

presenting, via the at least one processor, the interpreted semantic information described in adult language to an adult user.

17. The non-transitory storage medium according to claim 16, wherein the method further comprises:

marking the recognized baby language information with baby language keywords.

18. The non-transitory storage medium according to claim 16, wherein the method further comprises:

marking the recognized environment information with environment keywords.

19. The non-transitory storage medium according to claim 16, wherein the method further comprises:

receiving, via a sound receiving device of the electronic device, sound of the surrounding environment where the baby is located upon receipt of the baby language;

recognizing, via the at least one processor, the environment information from the received environment sound.

20. The non-transitory storage medium according to claim 19, wherein the recognized environment information is marked with environment keywords.