PORTABLE ENGINE FOR ENTERTAINMENT, EDUCATION, OR COMMUNICATION

• US 20110234488A1
• Filed: 12/01/2009
• Published: 09/29/2011
• Est. Priority Date: 12/01/2008
• Status: Abandoned Application

• Current Assignee: National University of Singapore
• Original Assignee: National University of Singapore
• Inventors: Wang, Bin, Hou, Junsong, Ge, Shuzhi
• Application Number:
  US13/131,373
• Publication Number:
  US 20110234488A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves

Abstract

To simplify human-machine interaction, a portable interaction module includes multiple channels through which input is received. Different types of input mechanisms or sensors allow use of multiple techniques for capturing input, such as motion sensing, audio sensing, image tracking, image sensing, or physiological sensing. A fusion module included in the portable input device receives data from the input mechanisms or sensors and generates an input description identifying which input mechanisms or sensors receive data. The input description is communicated to a target device, which determines an output corresponding to the input description. Using multiple input capture techniques simplifies interaction with the target device by providing a variety of methods for obtaining input.

Claims

1. A multi-channel portable interaction module comprising:

one or more input devices, each input device including a plurality of input mechanisms for receiving input responsive to an interaction and one or more sensors for capturing data associated with an environment surrounding the input device;

a processor coupled to the one or more input devices;

computer program code stored on a memory and configured to be executed by the processor, the computer program code including instructions for;

receiving data from the plurality of input mechanisms and from the one or more sensors;

generating data describing at least one of;

an input received by an input mechanism and the data captured by a sensor and

generating an input description identifying input mechanisms or sensors having received input;

providing an identifier associated with each input mechanism indicating whether individual input mechanisms have received input

providing an identifier associated with each sensor indicating whether individual sensors have captured data; and

generating transmission data associated with the input description;

a communication module coupled to the processor, the communication module for transmitting the transmission data to a target electronic machine.

2. The multi-channel portable interaction module of claim 1, further comprising:

a feedback system coupled to the target device and to the communication module, the feedback system generating feedback responsive to feedback data received from the target device.

3. The multi-channel portable interaction module of claim 2, wherein the feedback system is configured to initiate tactile feedback by the multi-channel portable input device responsive to the feedback data.

4. The multi-channel portable interaction module of claim 1, wherein the one or more input devices comprise up to twenty input devices.

5. The multi-channel portable interaction module of claim 1, wherein the one or more sensors comprise at least one of a motion sensor, an audio sensor, an image sensor, and a physiological sensor.

6. The multi-channel portable interaction module of claim 5, wherein an input device is configured to receive input from an auxiliary input device external to the multi-channel portable interaction module.

7. The multi-channel portable interaction module of claim 5, wherein the fusion module is configured to generate a description of data captured by two or more sensors and an input received by a first input mechanism, each sensor capturing a different data type.

8. The multi-channel portable interaction module of claim 7, wherein the data type comprises at least one of audio data, video data, image data, audio data, motion data, and physiological data.

9. The multi-channel portable interaction module of claim 1, wherein the communication module is further coupled to an auxiliary input device in a location remote from the multi-channel portable input device.

10. The multi-channel portable interaction module of claim 1, further comprising one or more adjustable physical members.

11. A computing system comprising:

a portable input device including a plurality of input mechanisms for receiving input responsive to an interaction and one or more sensors for capturing data associated with an environment surrounding the multi-channel portable input device, the portable input device configured to generate an input description describing at least one of;

an input received by an input mechanism and the data captured by a sensor;

a target device coupled to the portable device and including an output device, the target device configured to receive the input description from the portable input device, generate an output from the input description, and present the output using the output device.

12. The computing system of claim 11, wherein the output comprises a visual signal and the output device comprises a display device.

13. The computing system of claim 11, wherein the target device includes a setting associating the input description with the output.

14. The computing system of claim 13, wherein the setting associates a command with input received by the input mechanism or with data captured by the secondary input device.

15. The computing system of claim 11, wherein the target device is selected from a group consisting of a robot, a computer, a set top box, a television and a gaming system.

16. The computing system of claim 11, further comprising an auxiliary input device coupled to the portable input device, the auxiliary input device for capturing data from a second location and communicating the captured data to the portable input device.

17. The computing system of claim 11, wherein the one or more sensors comprise at least one of a motion sensor, an audio sensor, an image sensor, and a physiological sensor.

18. The computing system of claim 17, wherein the input description describes data captured by two or more sensors and an input received by a first input mechanism, each sensor capturing a different data type.

19. The computing system of claim 18, wherein the data type comprises at least one of audio data, video data, image data, audio data, motion data, and physiological data.

20. The computing system of claim 11, wherein the one or more sensors are positioned at one or more locations in an environment proximate to the multi-channel portable input device.