Media capture and compression communication system using holographic optical classification, voice recognition and neural network decision processing

• US 6,216,267 B1
• Filed: 07/26/1999
• Issued: 04/10/2001
• Est. Priority Date: 07/26/1999
• Status: Expired due to Term

• Current Assignee: Rockwell Collins, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Original Assignee: Rockwell Collins, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Inventors: Mitchell, James P.
• Primary Examiner(s): Faile, Andrew
• Assistant Examiner(s): Tran, Hai V.
• Application Number:
  US09/360,512
• Time in Patent Office: 624 Days
• Field of Search: 348/6, 382/199, 382/210-212, 382/216, 382/232, 380/54, 704/275
• US Class Current: 725/93
• CPC Class Codes: G06N 3/02 Neural networks
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/60 using transform coding

Abstract

A system and method for capturing and processing audio and video images for optimized transmission over a lower bandwidth communications channel are disclosed. A digital processing system receives video and audio signals from a media source such that the video and audio signals are representative of captured images and sounds as a multimedia signal. An optical processing system is coupled to the digital processing system and performs signal processing algorithms on the multimedia signal. A transceiver transmits the multimedia signal over a lower bandwidth communications channel wherein the multimedia signal is optimized for transmission over the lower bandwidth communications channel by the signal processing algorithms performed by the optical processing system.

Claims

1. A system for capturing and processing video and audio for optimized transmission over a lower bandwidth communications channel, comprising:

a digital processing system for receiving a video signal and an audio signal from

a media source, the video signal being representative of an image captured by the media source and the audio signal being representative of sounds captured by the media source;

an optical processing system, coupled to said digital processing system, for performing a signal processing algorithm on the video signal and a for performing a signal processing algorithm on the audio signal; and

a transceiver for transmitting the video and audio signals over a lower bandwidth communications channel as a multimedia signal, wherein the signal processing algorithms performed by said optical processing system optimize the video and audio signals for transmission over the lower bandwidth communications channel;

said optical processing system comprising first and second spatial light modulators, said first spatial light modulator encoding audio signals onto a first light beam and said second spatial light modulator encoding video signals onto a second light beam, a lens system for focusing the first and second light beams through a photorefractive crystal, said photorefractive crystal being actuated with a control light beam such that a holographic output is provide by said photorefractive crystal, and a detector for detecting the holographic output of said photorefractive crystal and providing an output in response thereto, the output of said detector being representative of a signal processing routine performed on the video or audio signals by said optical processing system.

2. A system as claimed in claim 1, said digital processing system comprising a semiconductor processor and a memory coupled to said semiconductor processor, said semiconductor processor for executing a program of instructions stored in said memory.

3. A system as claimed in claim 1, said optical processing system being configured to perform a compression algorithm on the video or audio signal.

4. A system as claimed in claim 1, said optical processing system being configured to perform a correlation algorithm on the video signal or the audio signal, respectively, and a reference signal.

5. A system as claimed in claim 1, said optical processing system being configured to perform a transform algorithm on the video signal or the audio signal.

6. A system as claimed in claim 1, said optical processing system being configured to perform an inverse transform on the video signal or the audio signal.

7. A system as claimed in claim 1, the audio signal being captured with an audio transducer, said optical processing system being configured to perform voice command recognition of the audio signal for controlling the system.

8. A system as claimed in claim 1, said optical processing system being configured to perform a neural network algorithm.

9. A system as claimed in claims 1, said optical processing system being configured to perform a compression algorithm on the video or audio signals as received and delivered through a TCP/IP packet communications network.

10. A system for capturing and processing video and audio signals for optimized transmission over a lower bandwidth communications channel, comprising:

means for receiving a video signal and an audio signal, the video signal being representative of captured images, and the audio signal being representative of captured sounds;

processing means, coupled to said signal receiving means, for performing an optical signal processing algorithm on the video signal and the audio signal; and

means for transmitting the video signal and the audio signal over a lower bandwidth communications channel as a multimedia signal, wherein the optical signal processing algorithm performed by said processing means optimizes the video and audio signals for transmission over the lower bandwidth communications channel;

said processing system comprising first and second means for encoding a signal onto a beam of light, said first encoding means encoding the video signal onto a first light beam and said encoding means encoding the audio signal onto a second light beam, means for focusing the first and second light beams through means for storing data holographically, said holographic data storage means being actuated with a control light beam such that a holographic output is provide by said holographic data storage means, and means for detecting the holographic output of said holographic data storage means and providing an output in response thereto, the output of said detecting means being representative of a signal processing routine performed on the video or audio signals by said processing means.

11. A system as claimed in claim 10, said signal receiving means comprising electronic processing means and means, coupled to said electronic processing means, for storing a program of instructions, said electronic processing means executing a program of instructions stored in said storing means.

12. A system as claimed in claim 10, said processing means being configured to perform a compression algorithm on the video or audio signals.

13. A system as claimed in claim 10, said processing means being configured to perform a correlation algorithm on the video or audio signals, respectively, and a reference signal.

14. A system as claimed in claim 10, said processing means being configured to perform a transform algorithm on the video or audio signals.

15. A system as claimed in claim 10, said processing means being configured to perform an inverse transform on the video or audio signals.

16. A system as claimed in claim 10, the audio signal being captured with means for transducing an audio signal, said processing means being configured to perform voice command recognition of the audio signal for controlling the system.

17. A system as claimed in claim 10, said processing means being configured to perform a neural network algorithm.

18. A system as claimed in claim 10, said processing means being configured to perform a compression algorithm on the video or audio signals as received and delivered through a TCP/IP packet communications network.

19. A method for transmitting a video signal and an audio signal over a lower bandwidth communications channel, comprising:

capturing images and sounds and providing the images and sounds as a multimedia signal;

optimizing the multimedia signal for transmission over a lower bandwidth communications channel by performing signal processing algorithms on the multimedia signal with an optical processing system; and

transmitting the optimized multimedia signal over the lower bandwidth communications channel;

the optical processing system comprising first and second spatial light modulators, said first spatial light modulator encoding audio signals onto a first light beam and said second spatial light modulator encoding video signals onto a second light beam, a lens system for focusing the first and second light beams through a photorefractive crystal, said photorefractive crystal being actuated with a control light beam such that a holographic output is provide by said photorefractive crystal, and a detector for detecting the holographic output of said photorefractive crystal and providing an output in response thereto, the output of said detector being representative of a signal processing routine performed on the video or audio signals by said optical processing system.

20. A method as claimed in claim 19, further comprising the steps of receiving the optimized multimedia signal and decoding the optimized multimedia signal with an optical processing system whereby the images may be displayed on a display and the sounds may be reproduced.