Immersive Multimedia Terminal

• US 20110242305A1
• Filed: 04/01/2011
• Published: 10/06/2011
• Est. Priority Date: 04/01/2010
• Status: Abandoned Application

• Current Assignee: Yanntek Incorporated
• Original Assignee: Yanntek Incorporated
• Inventors: Peterson, Harry W., Peterson, Jean Gabriel, Peterson, Erik Yann, Manuelian, Diana Hawkins
• Application Number:
  US13/078,322
• Publication Number:
  US 20110242305A1
• Time in Patent Office: Days
• US Class Current: 348/77
• CPC Class Codes: G01S 15/003 Bistatic sonar systems; Multistatic sonar systems
• CPC Class Codes: G01S 15/876 Combination of several spaced transmitters or receivers of known location for determining the position of a transponder or a reflector G01S15/872 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/043 using propagating acoustic waves
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Various embodiments of the present invention teach an advantageous means of conducting and controlling multimedia communication. Real-world communication involving sight, sound and body language is fully supported, without requiring that the user wear or touch any special apparatus. A novel Device-Area-Network (DAN) method is introduced to allow devices contained in compatible apparatus external to the Immersive Multimedia Terminal (IMT) to be discovered and fused to the devices within the IMT. Said method allows seamless integration of cellphones, laptops and other compatible apparatus so that they can use the IMT as a high-performance terminal. Said method also allows the IMT to fully integrate resources that exist in said external compatible apparatus. Examples of said resources are microphones, environmental sensors, disk drives, flash memory, cameras, and wired or wireless communication links.

Claims

1. A gesture recognition system comprising:

one or more spatially-distributed acoustic emitters each configured for sending an ultrasonic acoustic signal;

a plurality of spatially distributed receivers each configured for receiving echoes produced when said acoustic signal is reflected by one or more spatially distributed objects and further configured to receive audible acoustic signals;

a timing-control circuit configured for controlling timing of emission of acoustic signals at each of the acoustic emitters and measuring timing of receipt of acoustic signals received at each of the receivers; and

a computing device configured to calculate characteristic information regarding the spatially distributed objects that reflect acoustic energy, to transform the characteristic information into a matrix of bits and to store the matrix of bits in memory, the characteristic information including a human gesture.

2. The system of claim 1, wherein each of the receivers comprises a microphone configured to detect ultrasonic sound and a microphone configured to detect audible sound.

3. The system of claim 1, wherein the receivers are further configured to operate as an audio input for a telephone or video conferencing system.

4. The system of claim 1, wherein said signal comprises a series of wavelets spaced in time such that the interval between wavelets is larger than the quotient of path delay divided by a maximum round-trip path length from emitter to object to receiver.

5. The system of claim 4, wherein the series of wavelets are emitted in sequential manner by a plurality of transducers within at least one of the spatially distributed objects.

6. The system of claim 1, wherein the plurality of receivers includes an array of elements comprised of MEMS microphones connected to sigma-delta converters configured to produce phase-coherent digital representation of the acoustic energy detected at each receiver.

7. The system of claim 1, wherein said emitters include a plurality of audio transducers configured to generate human-audible sounds and also generate ultrasound.

8. The system of claim 1, wherein the computing device is configured to reject receiver measurements that do not correspond to echoes produced by acoustic reflections.

9. A gesture recognition system comprising:

one or more spatially-distributed acoustic emitters configured to send acoustic signals;

a plurality of spatially distributed receivers configured for receiving echoes produced when the acoustic signal is reflected by a plurality of spatially distributed objects;

a timing-control circuit configured to control timing of emission of the acoustic signals, to measure timing of receipt of the echoes received at each of the receivers; and

a computing device configured to accurately determine characteristic information regarding the spatially distributed objects based on the received echoes and to recognize a gesture made with a human hand based on the characteristic information.

10. The system of claim 9, further comprising a display, movement of a cursor on the display being responsive to the gesture.

11. The system of claim 9, wherein the computing device is configured to turn on the display in response to the gesture.

12. The system of claim 9, further comprising a camera, wherein the computing device is configured to use both image data collected by the camera and the characteristic information to recognize the gesture.

13. The system of claim 12, wherein the camera is configured to detect infrared light.

14. The system of claim 9, wherein at least one of the objects includes an object worn by a person.

15. The system of claim 9, wherein at least one of the objects is configured to emit a radio or acoustic signal.

16. The system of claim 9, wherein the characteristic information includes data characterizing a location and a shape of at least one of the objects.

17. The system of claim 9, wherein the characteristic information includes data characterizing a movement of at least one of the objects.

18. The system of claim 9, wherein the computing device is configured to control the display in response to the gesture.