INTERFACE APPARATUS AND METHOD FOR PROVIDING INTERACTION OF A USER WITH NETWORK ENTITIES

• US 20150154492A1
• Filed: 02/04/2015
• Published: 06/04/2015
• Est. Priority Date: 11/11/2013
• Status: Active Grant

• Current Assignee: Echo Smartlab LLC, MERA Software Services, Inc.
• Original Assignee: MERA Software Services, Inc.
• Inventors: PONOMAREV, Dmitrii Maximovich, MIKHAYLOV, Nikolay Nikolaevich
• Granted Patent: US 9,396,437 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: A63H 3/28 Arrangements of sound-producing means in dolls; Means in dolls for producing sounds
• CPC Class Codes: A63H 3/36 Details; Accessories
• CPC Class Codes: G06N 3/004 Artificial life, i.e. computing arrangements simulating life
• CPC Class Codes: G06N 3/008 based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. based on robots replicating pets or humans in their appearance or behaviour
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06N 5/047 Pattern matching networks; Rete networks
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: H04J 11/00 Orthogonal multiplex systems, e.g. using WALSH codesH04J13/00 takes precedence
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/70 Services for machine-to-machine communication [M2M] or machine type communication [MTC]
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

An interface apparatus, system and method for providing interaction over a communication network between a user and network entities are described. The interface apparatus includes a front-end communication system configured for receiving user input information and for outputting output signals in response to the input information. The interface apparatus also includes a communication processing system for coding the input information and forwarding it to the network entity. The interface apparatus can also include a front-end monitoring system for generating user state patterns indicative of the state of the user, a decision-making system for processing the patterns and taking a decision as to how to respond thereto. The interface apparatus includes a configuration and control system configured for reconfiguration and control of functionality of the interface apparatus and for reconfiguration and control of functionality of the network entities.

Claims

1. An interface apparatus for providing interaction over a communication network between a user and a plurality of network entities cooperating with said interface apparatus under a predetermined service agreement stored in the interface apparatus, the interface apparatus comprising:

a front-end communication system including;

at least one front-end communication input device configured for interaction with the user for receiving user input information and generating user information input signals, and

at least one front-end communication output device configured for interaction with the user for outputting user information output signals obtained as a reaction to the user input information;

a communication processing system coupled to the front-end communication system and configured for

(i) receiving said user information input signals for coding thereof to a format suitable for data transferring the coded information input signals to at least one network entity selected from said plurality of network entities over said communication network to handle said coded information input signals at the end of said at least one network entity, thereby to generate information coded output signals responsive to said user information input signals; and

(ii) receiving said information coded output signals generated by said at least one network entity; and

decoding these signals to a format suitable for outputting thereof by said at least one front-end output device; and

a configuration and control system configured for

(i) automatic reconfiguration and control of a functionality of the interface apparatus, including;

selecting desired functional characteristics of the interface apparatus; and

adjusting said interface apparatus to operating conditions of the communication network, including network availability; and

(ii) automatic reconfiguration and control of functionality of interaction of said at least one network entity with the interface apparatus, including adjusting said interaction to predetermined requirements imposed on said at least one network entity for desired cooperation with said interface apparatus in accordance with said predetermined service agreement; and

a wireless network connector electrically coupled to said communication processing system, and to said configuration and control system;

said wireless network connector configured for providing a wireless signal linkage between the interface apparatus and said plurality of network entities over the communication network.

2. The interface apparatus of claim 1, further comprising:

a front-end monitoring system including at least one front-end monitoring device configured for interacting with the user, collecting user state information related to a state of the user and generating user state patterns indicative of the state of the user;

a decision-making system coupled to said front-end monitoring system and to wireless network connector, and configured for receiving the user state patterns collected by said at least one front-end monitoring device, and processing thereof for taking a decision as to how to respond to the received user state patterns.

3. The interface apparatus of claim 2, further comprising an interface for remote monitoring coupled to said wireless network connector, said communication processing system and to said decision-making system, and configured for interaction of the interface apparatus with said plurality of network entities via said wireless network connector.

4. The interface apparatus of claim 1, wherein said at least one front-end communication input device of the front-end communication system is selected from a microphone configured for receiving said user input information provided verbally and converting said user information into the user information input signals corresponding to the user verbal input information;

and a video camera configured for receiving said user information provided visually and converting said user information into the user information input signals corresponding to the visual user information.

5. The interface apparatus of claim 4, wherein said at least one front-end communication output device of the front-end communication system is selected from a speaker configured for audio outputting said user information output signals, and a display configured for video outputting said user information output signals, wherein said user information output signals are indicative of a reaction of said at least one network entity to said user information input signals.

6. The interface apparatus of claim 5, wherein said communication processing system comprises:

an encoding and decoding module coupled to said at least one front-end communication input device and to said at least one front-end communication output device of the front-end communication system, said encoding and decoding module configured (i) for receiving the user information input signals including audio and video signals from said at least one front-end communication input device, coding thereof to obtain coded information input signals and forwarding said coded information input signals to the wireless network connector for relaying the coded information input signals to said at least one network entity; and

(ii) for receiving coded information output signals and decoding these signals to obtain said user information output signals;

a speech synthesizer coupled to the speaker and to the encoding and decoding module for encoding and decoding audio signals, and configured to receive decoded information output signals and to generate electrical signals in a format suitable for audio outputting thereof by the speaker; and

a view synthesizer coupled to the display and to the encoding and decoding module for encoding and decoding video signals, and configured to receive decoded information output signals and to generate electrical signals in a format suitable for video outputting thereof by the display.

7. The interface apparatus of claim 3, further comprising a local dialogue organization device coupled to the speech synthesizer and to said interface for remote monitoring and configured for organization of local dialogues between the user and the interface apparatus.

8. The interface apparatus of claim 3, wherein said at least one front-end monitoring device of the front-end monitoring system is selected from the list including:

a tactile sensor configured to provide user state information indicative of a force applied by the user to the interface apparatus;

at least one user physiological parameter sensor configured for measuring at least one vital sign of the user;

a user location sensor configured for determination of a location of the interface apparatus;

an accelerometer configured for detecting motion of the interface apparatus; and

a gyroscope configured for measuring orientation of the interface apparatus in space.

9. The interface apparatus of claim 8, wherein said at least one user physiological parameter sensor is selected from the list including:

a temperature sensor, a pulse rate sensor, a blood pressure sensor, a pulse oximetry sensor, and a plethysmography sensor.

10. The interface apparatus of claim 3, wherein said decision-making system comprises:

a sensor data collection device configured for receiving the user state patterns measured by the front-end monitoring system and formatting thereof;

a pattern recognition device coupled to the sensor data collection device and configured for comparing the user state patterns with reference state patterns stored in the interface apparatus, and generating an identification signal indicative of whether at least one of the user state patterns matches or does not match at least one reference state pattern, said reference state patterns being indicative of various predetermined states of the user and being used as a reference for determining a monitored state of the user;

a pattern storage device coupled to the pattern recognition device and configured for storing said reference state patterns;

a decision maker device coupled to said pattern recognition device, and configured for receiving said identification signal from the pattern recognition device, and in response to said identification signal, generating said coded information output signals indicative of at least one policy for taking said decision; and

a policy storage device coupled to the decision maker device and configured for storing policies for the taking of the decision.

11. The interface apparatus of claim 10, wherein the policy for the taking of the decision includes:

(i) if at least one of the user state patterns matches at least one reference state pattern, to generate said coded information output signals including advice of the decision-making system as a reaction to the monitored state of the user, and provide said coded information output signals to at least one receiver selected from a corresponding at least one network entity selected from said plurality of network entities configured for handling the advice, and

said communication processing module of the interface apparatus further configured for decoding said coded information output signals for extracting the advice, and outputting the advice to the user; and

(ii) if none of the user state patterns matches at least one reference state pattern, to forward the monitored user state patterns to at least one network entity being configured for handling the user patterns.

12. The interface apparatus of claim 3, wherein said configuration and control system includes:

a cyber certificate database comprising at least one record selected from;

a record with a description of functional characteristics of the interface apparatus,

a record with a description of functional characteristics of the network entities selected to cooperate with the interface apparatus for a predetermined purpose;

a record with a description of functional characteristics of said plurality of network entities providing services to which the interface apparatus has a right to access;

an archive record for interaction of the user with the interface apparatus; and

a cyber portrait of the user including at least one kind of characteristics selected from;

cognitive characteristics of the user, behavioral characteristics of the user, physiological characteristics of the user, and mental characteristics of the user;

a cyber certificate database controller coupled to the cyber certificate database, and configured for controlling an access to said at least one record stored in the cyber certificate database to read and update said at least one record; and

a reconfiguration device coupled to said cyber certificate database controller, and configured for dynamic reconfiguration of functionality of the interface apparatus, and interaction of said at least one network entity with the interface apparatus in accordance with said predetermined service agreement.

13. The interface apparatus of claim 12, wherein said dynamic reconfiguration of the functionality includes at least one of the following actions:

receiving external signals for (i) adjusting said interface apparatus to the operating conditions of the communication network, and (ii) adjusting operation of said at least one external entity to said predetermined requirements imposed on said at least one external entity for cooperation with said interface apparatus in accordance with said predetermined service agreement; and

providing instruction signals to said cyber certificate database controller to read and update said at least one record.

14. The interface apparatus of claim 13, wherein said at least one entity includes an entities control system configured for receiving from said configuration and control system of the interface apparatus a request for finding at least one network entity providing services desired to the interface apparatus in accordance with the conditions of the predetermined service agreement, conducting a semantic search of said at least one network entity, adjusting the interaction between the interface apparatus and said at least one network entity to the conditions of the predetermined service agreement, and providing addresses and access conditions of said at least one network entity to said configuration and control system.

15. The interface apparatus of claim 14, wherein said at least one entity providing services desired to the interface apparatus in accordance with the conditions of the predetermined service agreement includes at least one system selected from:

(a) an external dialogue system configured for organization and conduction of natural language dialogues with the user, configured for

receiving at least one type of input signals selected from said coded information input signals originating from the front-end communication system, and said user state patterns provided from the decision-making system; and

analyzing said at least one type of the input signals and generating said coded information output signals indicative of reaction on said coded information input signals;

(b) a supervisor communication support system configured for finding a supervisor communication device used by a supervisor of the user and supporting communication of said at least one user interface apparatus with the supervisor communication device; and

(c) a peer communication support system configured for finding at least one other interface apparatus used by a peer to the user, and for supporting communication between the interface apparatus of the user and said at least one other interface apparatus.

16. The interface apparatus of claim 14, wherein said at least one entity providing cloud services desired to the interface apparatus in accordance with the conditions of the predetermined service agreement includes a situation identification system configured for receiving said coded information input signals from the front-end communication system and said user state patterns forwarded by the decision-making system, and providing analysis thereof for identifying various situations occurring with the user and notifying said supervisor communication support system of the situations as they are discovered.

17. The interface apparatus of claim 15, wherein said external dialogue system comprises a speech recognition system configured for receiving said coded information input signals originating from the front-end communication system and transforming these signals into data suitable for computer processing, and a dialogue manager coupled to the speech recognition system, and configured to process said data and to generate said coded information output signals produced as a reaction to said coded information input signals.

18. The interface apparatus of claim 17, wherein said coded information input signals include a query signal;

and wherein the external dialogue system further comprises a search engine associated with the dialogue manager and configured for receiving a processed query signal from the dialogue manager, conducting a search based on a query related to said query signal and providing search results to the dialogue manager for targeting thereof to the user;

wherein said search results are included in said coded information output signals.

19. The interface apparatus of claim 17, wherein said coded information input signals include said user state patterns forwarded by the decision-making system, and wherein the external dialogue system is further configured to analyze said user state patterns forwarded by the decision-making system, and generate advice of the entity as a reaction to the monitored state of the user, wherein the entity advice is included in said coded information output signals.

20. The interface apparatus of claim 15, wherein the user is a child, and the supervisor is a parent of the child, and said supervisor communication device is a communication device of the parent.

21. The interface apparatus of claim 16, wherein the situation identification system is configured to communicate with at least one system providing a medical diagnostics service.

22. The interface apparatus of claim 15, wherein the user is a child, and the peer is another child.

23. A method for providing interaction of users with a plurality of network entities over a communication network by the interface apparatus configured to provide interaction between a user and a plurality of network entities cooperating with said interface apparatus under a predetermined service agreement stored in the interface apparatus, the method comprising at the interface apparatus end:

automatically reconfiguring and controlling functionality of the interface apparatus, including automatic selecting of desired functional characteristics of the interface apparatus; and

adjusting said interface apparatus to operating conditions in the communication network, including network availability;

automatically reconfiguring and controlling functionality of interaction of said at least one network entity with the interface apparatus, including adjusting said interaction to predetermined requirements imposed on said at least one network entity for desired cooperation with said interface apparatus in accordance with said predetermined agreement;

receiving user input information from the user;

processing said user input information and forwarding the corresponding processed signal to at least one entity selected from said plurality of entities configured for handling a communication with the user; and

receiving coded information output signals from said at least one entity, processing thereof to obtain user information output signals in a format suitable for outputting to the user.

24. The method of claim 23, comprising:

collecting user state information related to a state of the user and generating user state patterns indicative of the state of the user;

receiving the user state patterns and processing thereof; and

taking a decision as to how to respond to the received user state patterns;

wherein said taking of the decision as to how to respond to the received user state patterns comprises;

(i) if at least one of the user state patterns matches at least one reference state pattern, taking a decision to generate said coded information output signals including advice indicative of reaction on the monitored state of the user, and processing said coded information output signals for extracting the advice and outputting it to the user; and

(ii) if none of the user state patterns matches at least one reference state pattern, forwarding the monitored user state patterns to a corresponding at least one entity configured for handling the user patterns.

25. The method of claim 24, wherein the processing of the user state patterns includes comparing the user state patterns with reference state patterns stored in the interface apparatus, said reference state patterns being indicative of various predetermined states of the user and being used as a reference for determining a monitored state of the user;

and taking a decision as to how to respond to the received user state patterns.

26. The method of claim 23, further comprising at the end of at least one entity:

receiving said coded information input signals from the interface apparatus;

analyzing said coded information input signals and generating said coded information output signals indicative of reaction on said coded information input signals; and

relaying said coded information output signals to the interface apparatus.

27. The method of claim 24, further comprising at the end of at least one entity:

receiving said user state patterns from the interface apparatus;

analyzing said user state patterns and generating said coded information output signals indicative of reaction on said coded information input signals; and

relaying said coded information output signals to the interface apparatus.

28. The method of claim 23, comprising at the end of at least one entity:

receiving said coded information input signals from the interface apparatus;

providing analysis thereof for identifying various situations occurring with the user;

finding a supervisor communication device used by a supervisor of the user; and

providing communication of the supervisor communication device with the interface apparatus of the user.

29. The method of claim 24, comprising at the end of at least one entity:

receiving said user state patterns from the interface apparatus;

providing analysis thereof for identifying various situations occurring with the user;

finding a supervisor communication device used by a supervisor of the user; and

providing communication of the supervisor communication device with the interface apparatus of the user.

30. The method of claim 23, comprising at the end of at least one entity:

receiving said coded information input signals from the interface apparatus;

finding at least one another interface apparatus used by a peer to the user; and

providing communication between the interface apparatus of the user and said at least one another interface apparatus.