Apparatus, system and method for a remotely monitored and operated avatar

• US 20020128746A1
• Filed: 02/27/2001
• Published: 09/12/2002
• Est. Priority Date: 02/27/2001
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Yu, Philip S., Grey, William, Moskowitz, Paul Andrew, Boies, Stephen J., Greene, David Perry, Dinkin, Samuel H.
• Application Number:
  US09/794,269
• Publication Number:
  US 20020128746A1
• Time in Patent Office: Days
• US Class Current: 700/245
• CPC Class Codes: G06N 3/008 based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. based on robots replicating pets or humans in their appearance or behaviour

Abstract

An apparatus, system and method for a remotely monitored and operated avatar is provided. The avatar is provided with one or more sensors for sensing environmental conditions of the environment in which the avatar is located. The one or more sensors send sensor data to a data processing system in the avatar which may perform processing and analysis on the sensor data to determine instructions for controlling the operation of the avatar such that the avatar interacts with an entity under observation. In addition, the avatar may transmit the sensor data to a remote assisted living server and/or remote observation center. The remote assisted living server and/or remote observation center may then perform processing and analysis of the sensor data to generate instructions which are transmitted to the avatar. In this way, the processing and analysis of the sensor data may be distributed amongst the avatar, the remote assisted living server, and the remote observation center, or any portion thereof. The avatar is preferably provided with aesthetic qualities that cause the entity under observation to establish a feeling of companionship with the avatar.

Claims

1. A method of controlling an interactive avatar used to interact with an entity, comprising:

sensing at least one environmental condition;

determining at least one instruction based on the at least one environmental condition; and

controlling operation of the avatar based on the at least one instruction such that the avatar interacts with the entity in accordance with the at least one environmental condition.

2. The method of claim 1, wherein the avatar has aesthetic qualities of a pet animal.

3. The method of claim 1, wherein the avatar is one of a computerized animal, human, fanciful creature, and simulated inanimate object.

4. The method of claim 1, wherein sensing at least one environmental condition includes sensing the at least one environmental condition using one or more sensors associated with the avatar.

5. The method of claim 4, wherein the one or more sensors include one or more of an audio pickup device, video monitoring device, an aroma detection device, a vibration sensor, and a position sensor.

6. The method of claim 1, wherein determining at least one instruction based on the at least one environmental condition includes transmitting sensor data representing the at least one environmental condition to a remote server.

7. The method of claim 6, wherein the sensor data representing the at least one environmental condition is transmitted to the remote server using one or more of a radio transceiver, an infrared transceiver, a coaxial cable connection, a wire or wireless telephone communication connection, a cellular or satellite communication connection, and a Bluetooth™

transceiver.

8. The method of claim 1, wherein determining at least one instruction based on the at least one environmental condition includes processing sensor data representing the at least one environmental condition in a processor local to the avatar.

9. The method of claim 1, wherein determining at least one instruction based on the at least one environmental condition includes comparing schedule information to an internal clock of the avatar and generating at least one instruction based on the comparison.

10. The method of claim 1, wherein the at least one instruction includes at least one of an instruction to provide audible output from the avatar, an instruction to generate movement of the avatar, an instruction to generate visual output from the avatar, an instruction to dispense medication from the avatar, an instruction to contact emergency services, an instruction to sound an alarm, and an instruction to notify a remote observation center.

11. The method of claim 1, wherein determining at least one instruction based on the at least one environmental condition includes using one or more of a neural network system, expert system, rule based system inference engine, voice recognition system, and motion detection system to determine the at least one instruction.

12. The method of claim 1, wherein determining at least one instruction based on the at least one environmental condition includes receiving the at least one instruction from a remotely located human operator.

13. The method of claim 1, wherein the method is implemented by the avatar.

14. The method of claim 1, wherein the method is implemented in a distributed data processing system.

16. The apparatus of claim 15, wherein the avatar has aesthetic qualities of a pet animal.

17. The apparatus of claim 15, wherein the avatar is one of a computerized animal, human, fanciful creature, and simulated inanimate object.

18. The apparatus of claim 15, wherein the means for sensing at least one environmental condition includes one or more sensors associated with the avatar.

19. The apparatus of claim 18, wherein the one or more sensors include one or more of an audio pickup device, video monitoring device, an aroma detection device, a vibration sensor, and a position sensor.

20. The apparatus of claim 15, wherein the means for determining at least one instruction based on the at least one environmental condition includes means for transmitting sensor data representing the at least one environmental condition to a remote server.

21. The apparatus of claim 20, wherein the means for transmitting sensor data includes one or more of a radio transceiver, an infrared transceiver, a coaxial cable connection, a wire or wireless telephone communication connection, a cellular or satellite communication connection, and a Bluetooth™

transceiver.

22. The apparatus of claim 15, wherein the means for determining at least one instruction based on the at least one environmental condition includes means for locally processing sensor data representing the at least one environmental condition in the avatar.

23. The apparatus of claim 15, wherein the means for determining at least one instruction based on the at least one environmental condition includes means for comparing schedule information to an internal clock of the avatar and means for generating at least one instruction based on the comparison.

24. The apparatus of claim 15, wherein the at least one instruction includes at least one of an instruction to provide audible output from the avatar, an instruction to generate movement of the avatar, an instruction to generate visual output from the avatar, an instruction to dispense medication from the avatar, an instruction to contact emergency services, an instruction to sound an alarm, and an instruction to notify a remote observation center.

25. The apparatus of claim 15, wherein the means for determining at least one instruction based on the at least one environmental condition includes one or more of a neural network system, expert system, rule based system inference engine, voice recognition system, and motion detection system.

26. The apparatus of claim 15, wherein the means for determining at least one instruction based on the at least one environmental condition includes means for receiving the at least one instruction from a remotely located human operator.

28. The method of claim 27, wherein the avatar has aesthetic qualities of a pet animal.

29. The method of claim 27, wherein the avatar is one of a computerized animal, human, fanciful creature, and simulated inanimate object.

30. The method of claim 27, wherein sensing at least one environmental condition includes sensing the at least one environmental condition using one or more sensors associated with the avatar.

31. The method of claim 30, wherein the one or more sensors include one or more of an audio pickup device, video monitoring device, an aroma detection device, a vibration sensor, and a position sensor.

32. The method of claim 27, wherein determining at least one instruction based on the at least one environmental condition includes transmitting sensor data representing the at least one environmental condition to a remote server.

33. The method of claim 32, wherein the sensor data representing the at least one environmental condition is transmitted to the remote server using one or more of a radio transceiver, an infrared transceiver, a coaxial cable connection, a wire or wireless telephone communication connection, a cellular or satellite communication connection, and a Bluetooth™

transceiver.

34. The method of claim 27, wherein determining at least one instruction based on the at least one environmental condition includes processing sensor data representing the at least one environmental condition in a processor local to the avatar.

35. The method of claim 27, wherein determining at least one instruction based on the at least one environmental condition includes comparing schedule information to an internal clock of the avatar and generating at least one instruction based on the comparison.

36. The method of claim 27, wherein the at least one instruction includes at least one of an instruction to provide audible output from the avatar, an instruction to generate movement of the avatar, an instruction to generate visual output from the avatar, an instruction to dispense medication from the avatar, an instruction to contact emergency services, an instruction to sound an alarm, and an instruction to notify a remote observation center.

37. The method of claim 27, wherein determining at least one instruction based on the at least one environmental condition includes using one or more of a neural network system, expert system, rule based system inference engine, voice recognition system, and motion detection system to determine the at least one instruction.

38. The method of claim 27, wherein determining at least one instruction based on the at least one environmental condition includes receiving the at least one instruction from a remotely located human operator.

39. The method of claim 27, wherein the method is implemented by the avatar.

40. The method of claim 27, wherein the method is implemented in a distributed data processing system.

15. An apparatus for controlling an interactive avatar used to interact with an entity, comprising:

means for sensing at least one environmental condition;

means for determining at least one instruction based on the at least one environmental condition; and

means for controlling operation of the avatar based on the at least one instruction such that the avatar interacts with the entity in accordance with the at least one environmental condition.

27. A computer program product in a computer readable medium for controlling an interactive avatar used to interact with an entity, comprising:

first instructions for sensing at least one environmental condition;

second instructions for determining at least one instruction based on the at least one environmental condition; and

third instructions for controlling operation of the avatar based on the at least one instruction such that the avatar interacts with the entity in accordance with the at least one environmental condition.

41. A method of remotely controlling an interactive avatar used to interact with an entity, comprising:

receiving sensed data from the avatar;

generating at least one instruction based on the sensed data, the at least one instruction being used by the avatar to control operation of the avatar such that the avatar interacts with the entity; and

transmitting the at least one instruction to the avatar.

42. The method of claim 41, wherein the avatar has aesthetic qualities of a pet animal.

43. The method of claim 41, wherein the avatar is one of a computerized animal, human, fanciful creature, and simulated inanimate object.

44. The method of claim 41, wherein transmitting the at least one instruction to the avatar includes transmitting the at least one instruction using one or more of a radio transceiver, an infrared transceiver, a coaxial cable connection, a wire or wireless telephone communication connection, a cellular or satellite communication connection, and a Bluetooth™

transceiver.

45. The method of claim 41, wherein the at least one instruction includes at least one of an instruction to provide audible output from the avatar, an instruction to generate movement of the avatar, an instruction to generate visual output from the avatar, an instruction to dispense medication from the avatar, an instruction to contact emergency services, an instruction to sound an alarm, and an instruction to notify a remote observation center.

46. The method of claim 41, wherein generating at least one instruction based on the sensed data includes using one or more of a neural network system, expert system, rule based system inference engine, voice recognition system, and motion detection system to determine the at least one instruction.

48. The method of claim 47, wherein the information representing the at least one environmental condition is received over a wired communication link.

49. The method of claim 47, wherein the information representing the at least one environmental condition is received over a wireless communication link.

50. The method of claim 47, wherein the external device is one of a thermostat, a door lock, a light fixture control, an entertainment system/device, a smoke detection device/system, a burglar alarm system, and a household appliance.

47. A method of controlling an interactive avatar used to interact with an entity, comprising:

receiving, from an external device, information representing at least one environmental condition;

determining at least one instruction based on the information representing the at least one environmental condition; and

controlling operation of the avatar based on the at least one instruction such that the avatar interacts with the entity in accordance with the at least one environmental condition.