ELECTRONIC PERSONAL INTERACTIVE DEVICE

• US 20110283190A1
• Filed: 05/12/2011
• Published: 11/17/2011
• Est. Priority Date: 05/13/2010
• Status: Active Grant

• Current Assignee: Poltorak Technologies, LLC
• Original Assignee: Poltorak Technologies, LLC
• Inventors: POLTORAK, Alexander
• Granted Patent: US 9,634,855 B2
• Time in Patent Office: Days
• US Class Current: 715/716
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser
• CPC Class Codes: G10L 15/142 Hidden Markov Models [HMMs]
• CPC Class Codes: G10L 15/16 using artificial neural networks
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: H04L 12/2818 from a device located outside both the home and the home network access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; arrangements for transmitting signals characterised by the use of a wireless eletrical link G08C17/00; telephonic communication systems adapted for combination with remote control systems H04M11/007
• CPC Class Codes: H04M 1/0202 Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets constructional features of telephone transmitters or receivers, e.g. of speakers or microphones H04M1/03
• CPC Class Codes: H04M 2250/10 including a GPS signal receiver
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]
• CPC Class Codes: H04W 84/18 Self-organising networks, e.g. ad-hoc networks or sensor networks

Abstract

An interface device and method of use, comprising audio and image inputs; a processor for determining topics of interest, and receiving information of interest to the user from a remote resource; an audiovisual output for presenting an anthropomorphic object conveying the received information, having a selectively defined and adaptively alterable mood; an external communication device adapted to remotely communicate at least a voice conversation with a human user of the personal interface device. Also provided is a system and method adapted to receive logic for, synthesize, and engage in conversation dependent on received conversational logic and a personality.

Claims

1. A user interface device comprising:

an audio visual information input configured to receive information sufficient to determine at least one of a topic of interest to a user and a query by a user, dependent on received audio visual information;

at least one audio visual output configured to present an anthropomorphic object controlled by at least one automated processor, conveying information of interest to the user, dependent on at least one of the determined topic of interest and the query; and

an audio visual telecommunication interface.

2. The user interface device of claim 1, wherein the at least one automated processor controls the anthropomorphic object to have an associated anthropomorphic mood which is selectively varied in dependence on at least one of the audio visual information input, the topic of interest, and the received information.

3. The user interface device of claim 1, wherein the audio visual information input and audio visual output are implemented on a self-contained cellular telephone communication device.

4. The user interface device of claim 1, wherein the at least one automated processor is further configured to respond to spoken commands, and to process the received information and to determine an emergency condition.

5. The user interface device of claim 4, wherein the at least one processor is configured to automatically telecommunicate information about the determined emergency condition without required human intervention.

6. The user interface device of claim 5, wherein the determined emergency is automatically telecommunicated with a responder selected from one or more of the group consisting police, fire, and emergency medical.

7. The user interface device of claim 1, further comprising a module configured to automatically interact with a social networking website based on at least an implicit user command.

8. The user interface device of claim 1, further comprising a module configured to automatically interact with a call center, and to automatically respond to the call center to transmit audio visual information.

9. The user interface device of claim 1, wherein the at least one processor is configured to automatically receive at least one unit of information of interest to the user from a resource remote from the device substantially without requiring an express request from the user, and to initiate an interaction with the user in response to receiving said at least one unit of information.

10. The user interface device of claim 1, wherein the anthropomorphic object is configured to represent a received image of a person, and to provide an audio output in a voice corresponding to a characteristic of the received image of the person.

11. The user interface device of claim 1, wherein the at least one processor is configured to present at least one advertisement responsive to at least one of the topic of interest and the query, and to permit the user to interact with the advertisement.

12. The user interface device of claim 1, wherein the audio visual information input comprises a structured light image capture device.

13. The user interface device of claim 1, wherein the at least one processor is configured to automatically generate a user profile generated based on at least prior interaction of the user.

14. The user interface device according to claim 1, wherein the anthropomorphic mood corresponds to a human emotional state, and the at least one processor is configured to determine a user emotional state based on at least the audio visual information.

15. A method comprising:

receiving audio visual information;

determining at least one of a topic of interest to a user and a query by a user, dependent on received audio visual information;

presenting an anthropomorphic object through an audio visual output controlled by at least one automated processor, conveying information of interest to the user, dependent on at least one of the determined topic of interest and the query; and

telecommunicating audio visual information through a telecommunication interface.

16. The method of claim 15, wherein the anthropomorphic object is automatically controlled to have an associated anthropomorphic mood which is selectively varied in dependence on at least one of the audio visual information input, the topic of interest, and the received information

17. The method of claim 15, wherein said receiving, presenting and telecommunicating are performed using a self-contained cellular telephone communication device, further comprising responding to spoken commands.

18. The method of claim 15, further comprising automatically determining an existence of an emergency condition involving the user, and telecommunicating information dependent on the determination to an emergency responder.

19. The method of claim 15, wherein the at least one of the topic of interest and query is automatically derived from the audio visual information and telecommunicated through the telecommunication interface to the Internet.

20. The method of claim 15, further comprising automatically receiving at least one unit of information of interest to the user from a resource remote from the device substantially without requiring an express request from the user, and proactively interacting with the user in response to receiving said at least one unit of information.

21. The method of claim 15, wherein the anthropomorphic object is presented to emulate a received image of a person, and is associated with a speech output which emulates a voice corresponding to a characteristic of the person represented in the received image of the person.

22. The method of claim 15, further comprising presenting at least one advertisement responsive to at least one of the topic of interest and the query, and financially accounting for at least one of a presentation of the at least one advertisement and a user interaction with the at least one advertisement.

23. The method of claim 15, further comprising generating structured light, and capturing three-dimensional information based at least on the generated structured light.

24. The method of claim 15, further comprising capturing a user gesture, and controlling the anthropomorphic object in dependence on the user gesture.

25. The method of claim 15, further comprising automatically generating a user profile generated based on at least prior interaction with the user.

26. A method comprising:

defining an automated interactive interface having an anthropomorphic personality characteristic, for semantically interacting with a human user to receive user input and present information in a conversational style;

determining at least one of a topic of interest to a user dependent on the received user input;

automatically generating a query seeking information corresponding to the topic of interest from a database;

receiving information of interest to the user from the database, comprising at least a set of facts or information; and

providing at least a portion of the received facts or information to the user through the automated interactive interface, in accordance with the conversational style, responsive to the received user input, and the information of interest.

27. The method according to claim 26, wherein the conversational style is defined by a set of conversational logic comprising at least a persistent portion and an information of interest responsive portion.

28. The method according to claim 26, wherein the anthropomorphic personality characteristic comprises an automatically controlled human emotional state, the human emotional state being controlled responsive to at least the received user input.

29. The method according to claim 26, further comprising telecommunicating with the database through a wireless network interface.

30. A user interface system comprising:

an interactive interface; and

at least one automated processor configured to;

control the interactive interface to provide an anthropomorphic personality characteristic, configured to semantically interact with a human user to receive user input and present information in a conversational style;

determine at least one of a topic of interest to a user dependent on the received user input;

automatically generate a query seeking information corresponding to the topic of interest from a database;

receive information of interest to the user from the database, comprising at least a set of facts or information; and

provide at least a portion of the received facts or information to the user through the interactive interface, in accordance with the conversational style, responsive to the received user input, and the information of interest.

31. The system according to claim 30, wherein the conversational style is defined by a set of conversational logic comprising at least a persistent portion and an information of interest responsive portion.

32. The system according to claim 30, wherein the anthropomorphic personality characteristic comprises a human emotional state, the human emotional state being controlled responsive to at least the received user input.

33. The system according to claim 30, further comprising a wireless network interface telecommunications port configured to communicate with the database.