Robotic system and method for controlling the same

• US 20080255702A1
• Filed: 06/05/2007
• Published: 10/16/2008
• Est. Priority Date: 04/13/2007
• Status: Abandoned Application

• Current Assignee: National Taiwan University of Science & Technology (Government of Taiwan)
• Original Assignee: National Taiwan University of Science & Technology (Government of Taiwan)
• Inventors: Lin, Chyi-Yeu
• Application Number:
  US11/806,933
• Publication Number:
  US 20080255702A1
• Time in Patent Office: Days
• US Class Current: 700/245
• CPC Class Codes: G06N 3/008 based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. based on robots replicating pets or humans in their appearance or behaviour

Abstract

A method for controlling a robotic system. Expressional and audio information is received by an input unit and transmitted to the processor therefrom. The processor converts the expressional and audio information to corresponding expressional signals and audio signals. The expressional signals and audio signals are received by an expressional and audio synchronized output unit and synchronously transmitted therefrom. An expression generation control unit receives the expressional signals and generates corresponding expressional output signals. Multiple actuators enable an imitative face to create facial expressions according to the expressional output signals. A speech generation control unit receives the audio signals and generates corresponding audio output signals. A speaker transmits speech according to the audio output signals. Speech output from the speaker and facial expression creation on the imitative face by the actuators are synchronously executed.

Claims

1. A robotic system, comprising:

a robotic head;

an imitative face attached to the robotic head;

a processor;

an input unit electrically connected to the processor, receiving expressional and audio information and transmitting the same to the processor, wherein the processor converts the expressional and audio information to corresponding expressional signals and audio signals;

an expressional and audio synchronized output unit electrically connected to the processor, receiving and synchronously transmitting the expressional signals and audio signals;

an expression generation control unit electrically connected to the expressional and audio synchronized output unit, receiving the expressional signals and generating corresponding expressional output signals;

a plurality of actuators electrically connected to the expression generation control unit and connected to the imitative face, enabling the imitative face to create facial expressions according to the expressional output signals;

a speech generation control unit electrically connected to the expressional and audio synchronized output unit, receiving the audio signals and generating corresponding audio output signals; and

a speaker electrically connected to the speech generation control unit, transmitting speech according to the audio output signals, wherein speech output from the speaker and facial expression creation on the imitative face by the actuators are synchronously executed.

2. The robotic system as claimed in claim 1, further comprising an information media input device electrically connected to the input unit, wherein the expressional and audio information is transmitted to the input unit via the information media input device.

3. The robotic system as claimed in claim 2, wherein the processor comprises a timing control device timely actuating the information media input device.

4. The robotic system as claimed in claim 1, further comprising a network input device electrically connected to the input unit, wherein the expressional and audio information is transmitted to the input unit via the network input device.

5. The robotic system as claimed in claim 4, wherein the processor comprises a timing control device timely actuating the network input device.

6. The robotic system as claimed in claim 1, further comprising a radio device electrically connected to the input unit, wherein the expressional and audio information is transmitted to the input unit via the radio device.

7. The robotic system as claimed in claim 6, wherein the processor comprises a timing control device timely actuating the radio device.

8. The robotic system as claimed in claim 1, further comprising an audio and image analysis unit and an audio and image capturing unit, wherein the audio and image analysis unit is electrically connected between the input unit and the audio and image capturing unit, the audio and image capturing unit captures sounds and images and transmits the same to the audio and image analysis unit, and the audio and image analysis unit converts the sounds and images to the expressional and audio information and transmits the expressional and audio information to the input unit.

9. The robotic system as claimed in claim 8, wherein the audio and image capturing unit comprises a sound-receiving device and an image capturing device.

10. The robotic system as claimed in claim 1, further comprising a memory unit electrically connected between the processor and the expressional and audio synchronized output unit, storing the expressional signals and audio signals.

11. The robotic system as claimed in claim 10, wherein the processor comprises a timing control device timely transmitting the expressional signals and audio signals from the memory unit to the expressional and audio synchronized output unit.

12. A method for controlling a robotic system, comprising:

providing a robotic head, an imitative face, multiple actuators, and a speaker, wherein the imitative face is attached to the robotic head, and the actuators are connected to the imitative face;

receiving expressional and audio information by an input unit and transmitting the same to the processor therefrom, wherein the processor converts the expressional and audio information to corresponding expressional signals and audio signals;

receiving the expressional signals and audio signals by an expressional and audio synchronized output unit and synchronously transmitting the same therefrom;

receiving the expressional signals and generating corresponding expressional output signals by an expression generation control unit;

enabling the imitative face to create facial expressions by the actuators according to the expressional output signals;

receiving the audio signals and generating corresponding audio output signals by a speech generation control unit; and

transmitting speech from the speaker according to the audio output signals, wherein speech output from the speaker and facial expression creation on the imitative face by the actuators are synchronously executed.

13. The method as claimed in claim 12, further comprising transmitting the expressional and audio information to the input unit via an information media input device.

14. The method as claimed in claim 13, further comprising timely actuating the information media input device by a timing control device.

15. The method as claimed in claim 12, further comprising transmitting the expressional and audio information to the input unit via a network input device.

16. The method as claimed in claim 15, further comprising timely actuating the network input device by a timing control device.

17. The method as claimed in claim 12, further comprising transmitting the expressional and audio information to the input unit via a radio device.

18. The method as claimed in claim 17, further comprising timely actuating the radio device by a timing control device.

19. The method as claimed in claim 12, further comprising:

capturing sounds and images and transmitting the same to an audio and image analysis unit by an audio and image capturing unit; and

converting the sounds and images to the expressional and audio information and transmitting the expressional and audio information to the input unit by the audio and image analysis unit.

20. The method as claimed in claim 19, wherein the audio and image capturing unit comprises a sound-receiving device and an image capturing device.

21. The method as claimed in claim 12, further comprising storing the expressional signals and audio signals converted from the processor by a memory unit.

22. The method as claimed in claim 21, further comprising timely transmitting the expressional signals and audio signals from the memory unit to the expressional and audio synchronized output unit by a timing control device.