Image transmitter

• US 7,031,386 B2
• Filed: 09/18/2001
• Issued: 04/18/2006
• Est. Priority Date: 09/19/2000
• Status: Expired due to Fees

• Current Assignee: Godo Kaisha IP Bridge 1 (IP Bridge, Inc.)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Yamamoto, Akihiro, Mori, Toshiaki, Ibaraki, Susumu
• Primary Examiner(s): VO, TUNG T
• Application Number:
  US09/953,974
• Publication Number:
  US 20020048322A1
• Time in Patent Office: 1,673 Days
• Field of Search: 375/240.01, 375/240.02, 375/240.09, 375/240.12, 375/240.13, 375/240.15, 375/240.16, 375/240.25, 375/240.26, 348/152, 348/153, 348/154, 348/158, 348/160, 348/400.1, 348/401.1, 348/384.1, 382/232, 382/250, 382/248, 382/233, 360/48, 380/113, 370/476
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence

Abstract

A transmitter is capable of compressing an incoming image with a relatively small delay time and transmit the compressed image data to a receiver. Image data contains at least i pixel values of pixels arranged in line along a single direction, each pixel value being expressed in n bits. A transmitter for compressing such image data and transmitting the image data to a receiver via a transmission path includes a blocking section, a data compression section, and a data sending section. The blocking section takes every p pixel values among the i pixel values in the image data to form a data block, and sequentially outputs a plurality of the data blocks each including the p pixel values. The data compression section reduces an amount of data from each data block outputted from the blocking section and thereby outputs a compressed block. The data sending section sends the compressed block outputted from the data compression section onto the transmission path.

Claims

1. An image transmitter for compressing image data and transmitting the image data to a receiver via a transmission path,

wherein the image data at least contains i pixel values of pixels arranged in line along a single direction, each pixel value being expressed in n bits, the image transmitter comprising:

a blocking section for taking every p pixel values among the i pixel values in the image data to form a data block, and sequentially outputting a plurality of data blocks each including p pixel values;

a data compression section for reducing an amount of data from each data block outputted from the blocking section to output a compressed block for each data block, the data compression section compressing each data block based on a level value derived from a differential pulse code modulation result of two adjoining pixel values; and

a data sending section for sending each compressed block outputted from the data compression section onto the transmission path,

wherein i, n, and p are predetermined natural numbers, and the data compression section deletes a bit, among all bits of a data block, from each data block based on the level value,

wherein the data compression section comprises;

a DPCM encoding section for performing a differential pulse code modulation based on two adjoining pixel values in each data block generated by the blocking section to generate and output differential data;

a near-instantaneous compression section for performing a near-instantaneous compression for the differential data outputted from the DPCM encoding section to reduce a number of bits in the differential data, and generating and outputting compressed differential data; and

a packet assembling section for generating and outputting a data packet to the data sending section as the compressed block, the data packet containing a first pixel value in the data block generated by the blocking section and the respective compressed differential data outputted from the near-instantaneous compression section,

wherein the DPCM encoding section comprises;

a delay section for applying a predetermined delay amount to 1^st to (p−

1)^th pixel values in each data block generated by the blocking section, and outputting delayed pixel values; and

a subtraction section for calculating respective differences between 2 to p pixel values in each data block generated by the blocking section and 1^st to (p−

1)^th delayed pixel values outputted from the delay section to generate (p−

1) differential data as the differential data, and outputting the (p−

1) differential data to the near-instantaneous compression section, and

wherein the near-instantaneous compression section comprises;

a buffer section for storing the (p−

1) differential data outputted from the DPCM encoding section;

a level determination section for generating the level value based on each of the (p−

1) differential data outputted from the buffer section and outputting the level value, the level value determining a bit to be deleted from each of the (p−

1) differential data; and

a data reduction section for deleting the bit, as determined by the level value outputted from the level determination section, from each differential data outputted from the buffer section to generate (p−

1) compressed differential data as the compressed differential data, and outputting the (p−

1) compressed differential data to the packet assembling section.

2. The image transmitter according to claim 1, wherein:

the compressed block has a fixed length; and

the data sending section comprises;

a buffer section for storing the compressed block; and

a sending control section for sending the compressed block stored in the buffer section onto the transmission path.

3. The image transmitter according to claim 1, wherein the level determination section comprises:

a differential data selection section for selecting one of the respective (p−

1) differential data outputted from the buffer section which has a greatest absolute value, and outputting the selected differential data as a maximum differential data; and

a level selection section for selecting one of a predetermined number of the level values based on the maximum differential data outputted from the differential data selection section, and outputting the selected level value to the data reduction section.

4. The image transmitter according to claim 3, wherein:

the data reduction section deletes t bits, as determined by the level value outputted from the level determination section, from each differential data outputted from the buffer section to generate the (p−

1) compressed differential data; and

t is a natural number.

5. The image transmitter according to claim 1, wherein the data packet generated by the packet assembling section contains the first pixel value in each data block generated by the blocking section, the level value outputted from the level determination section, and the (p−

1) compressed differential data outputted from the data reduction section.

6. The image transmitter according to claim 1, wherein, when p pixel values among the i pixel values in the image data cannot be taken to form a data block, the blocking section generates a padded data block by using a predetermined padding bit, the padded data block having the same size as that of the data block.

7. A transmission system including the receiver and the image transmitter according to claim 1, wherein the receiver comprises:

a data receiving section for receiving the data packet transmitted via the transmission path and outputting the received data packet;

a packet disassembling section for disassembling the data packet outputted from the data receiving section into the first pixel value in the data block and the respective compressed differential data generated by the near-instantaneous compression section, and outputting the first pixel value in the data block and the respective compressed differential data;

a near-instantaneous decompression section for restoring the bits having been deleted from the compressed differential data generated by the near-instantaneous compression section to generate and output decompressed differential data;

a DPCM decoding section for performing an inverse process of the differential pulse code modulation performed by the DPCM encoding section, generating decoded pixel values from the respective decompressed differential data outputted from the near-instantaneous decompression section, and outputting the decoded pixel values; and

an image data reproduction section for generating reproduced image data from the first pixel value outputted from the packet disassembling section and the respective decoded pixel values outputted from the DPCM decoding section, the reproduced image data representing an image.

8. The transmission system according to claim 7, wherein:

the data packet has a fixed length; and

the data receiving section comprises;

a buffer section capable of storing at least the data packet of the fixed length; and

a reception control section for outputting the data packet stored in the buffer section to the packet disassembling section.

9. The transmission system according to claim 7, wherein the receiver further comprises:

a missing block recovery section for, when a data packet is missed by the data receiving section, reproducing pixel values contained in the missing data packet based on a first pixel value from at least one other data packet from the packet disassembling section and decoded pixel values from the at least one other data packet from the DPCM decoding section, and outputting the pixel values to the image data reproduction section.

10. A driving assistant system for assisting in the driving of a vehicle, the driving assistant system comprising:

a transmission path;

a plurality of image capturing devices each of which is fixed on the vehicle and which captures an image of surroundings of the vehicle and outputs captured image data;

a plurality of image processing sections each of which is connected to an image capturing device of the image capturing devices and performs a clipping process for the captured image data outputted from the respective image capturing device to generate partial image data, wherein each partial image data at least contains i pixel values of pixels arranged in line along a single direction, each pixel value being expressed in n bits; and

a plurality of transmitters each of which is associated with one of the plurality of image processing sections,

wherein each transmitter comprises;

a blocking section for taking every p pixel values among the i pixel values in the partial image data from the associated image processing section to form a data block, and sequentially outputting a plurality of data blocks each including p pixel values,

a data compression section for reducing an amount of data from each data block outputted from the blocking section to output a compressed block for each data block, the data compression section reducing the amount of data based on a level value derived from a different pulse code modulation result of two adjoining pixel values, and

a data sending section for sending each compressed block outputted from the data compression section onto the transmission path;

a receiver for receiving and decompressing each compressed block from the transmission path, restoring each data block, and reproducing the respective partial image data;

an image synthesis section for performing a synthesis process for the partial image data from the receiver and outputting merged image data, the merged image data representing an image in which images represented by the respective partial image data are synthesized; and

a display section for displaying the image represented by the merged image data outputted from the image synthesis section,

wherein i, n, and p are predetermined natural numbers, and the data compression section deletes a bit, among all bits of a data block, from each data block based on the level value,

wherein the data compression section of each transmitter comprises;

a DPCM encoding section for performing a differential pulse code modulation based on two adjoining pixel values in each data block generated by the blocking section to generate and output differential data;

a near-instantaneous compression section for performing a near-instantaneous compression for the differential data outputted from the DPCM encoding section to reduce a number of bits in the differential data, and generating and outputting compressed differential data; and

a packet assembling section for generating and outputting a data packet to the data sending section as the compressed block, the data packet containing a first pixel value in the data block generated by the blocking section and the respective compressed differential data outputted from the near-instantaneous compression section,

wherein the DPCM encoding section of each transmitter comprises;

a delay section for applying a predetermined delay amount to 1^st to (p−

1)^th pixel values in each data block generated by the blocking section, and outputting delayed pixel values; and

a subtraction section for calculating respective differences between 2^nd to p^th pixel values in each data block generated by the blocking section and 1^st to (p−

1)^th delayed pixel values outputted from the delay section to generate (p−

1) differential data as the differential data, and outputting the (p−

1) differential data to the near-instantaneous compression section, and

wherein the near-instantaneous compression section of each transmitter comprises;

a buffer section for storing the (p−

1) differential data outputted from the DPCM encoding section;

a level determination section for generating the level value based on each of the (p−

1) differential data outputted from the buffer section and outputting the level value, the level value determining a bit to be deleted from each of the (p−

1) differential data; and

a data reduction section for deleting the bit, as detenriined by the level value outputted from the level determination section, from each differential data outputted from the buffer section to generate (p−

1) compressed differential data as the compressed differential data, and outputting the (p−

1) compressed differential data to the packet assembling section.

11. A remote control system for exerting an action on an object via remote control, the remote control system comprising:

a transmission path;

an image capturing device which is provided in a neighborhood of the object and captures an image of surroundings of the object and outputs captured image data, wherein the captured image data at least contains i pixel values of pixels arranged in line along a single direction, each pixel value being expressed in n bits; and

a transmitter,

wherein the transmitter comprises;

a blocking section for taking every p pixel values among the i pixel values in the captured image data from the image capturing device to form a data block, and sequentially outputting a plurality of data blocks each including p pixel values;

a data compression section for reducing an amount of data from each data block outputted from the blocking section to output a compressed block for each data block, the data compression section reducing the amount of data based on a level value derived from a differential pulse code modulation result of two adjoining pixel values, and

a data sending section for sending each compressed block outputted from the data compression section onto the transmission path;

a receiver for receiving and decompressing each compressed block from the transmission path, restoring each data block, and reproducing the captured image data;

a display section for displaying the image represented by the captured image data outputted from the receiver for viewing by an operator;

a control data generation section for generating and outputting control data for exerting an action on the object in accordance with control made by the operator; and

a control data sending section for sending control data from the control data generation section onto the transmission path;

a control data receiving section for receiving and outputting the control data from the transmission path; and

a manipulator section for exerting the action on the object in accordance with the control data received from the control data receiving section,

wherein i, n, and p are predetermined natural numbers, and the data compression section deletes a bit, among all bits of a data block, from each data block based on the level value,

wherein the data compression section comprises;

a DPCM encoding section for performing a differential pulse code modtilation based on two adjoining pixel values in each data block generated by the blocking section to generate and output differential data;

a near-instantaneous compression section for performing a near-instantaneous compression for the differential data outputted from the DPCM encoding section to reduce a number of bits in the differential data, and generating and outputting compressed differential data; and

a packet assembling section for generating and outputting a data packet to the data sending section as the compressed block, the data packet containing a first pixel value in the data block generated by the blocking section and the respective compressed differential data outputted from the near-instantaneous compression section,

wherein the DPCM. encoding section comprises;

a delay section for applying a predetermined delay amount 1^st to (p−

1)^th pixel values in each data block generated by the blocking section, and outputting delayed pixel values; and

a subtraction section for calculating respective differences between 2^nd to p^th pixel values in each data block generated by the blocking section and 1^st to (p−

1)^th delayed pixel values outputted from the delay section to generate (p−

1) differential data as the differential data, and outputting the (p−

1) differential data to the near-instantaneous compression section, and

wherein the near-instantaneous compression section comprises;

a buffer section for storing the (p−

1) differential data outputted from the DPCM encoding section;

a level determination section for generating the level value based on each of the (p−

1) differential data outputted from the buffer section and outputting the level value, the level value determining a bit to be deleted from each of the (p−

1) differential data; and

a data reduction section for deleting the bit, as detennined by the level value outputted from the level determination section, from each differential data otitputted from the buffer section to generate (p−

1) compressed differential data as the compressed differential data, and outputling the (p−

1) compressed differential data to the packet assembling section.

12. An image compression and transmission method for compressing image data and transmitting the image data to a receiver via a transmission path,

wherein the image data at least contains i pixel values of pixels arranged in line along a single direction, each pixel value being expressed in n bits, the image compression and transmission method comprising:

a blocking operation of taking every p pixel values among the i pixel values in the image data to form a data block, and sequentially outputting a plurality of data blocks each including p pixel values;

a data compression operation of reducing an amount of data from each data block outputted in the blocking operation to output a compressed block for each data block based on a level value derived from a differential pulse code modulation result of two adjoining pixel values; and

sending each compressed block outputted in the data compression operation onto the transmission path,

wherein i, n, and p are predetermined natural numbers, and the data compression operation deletes a bit, among all bits of a data block, from each data block based on the level value,

wherein the data compression operation comprises;

a DPCM encoding operation of performing a differential pulse code modulation based on two adjoining pixel values in each data block generated by the blocking operation to generate and output differential data;

a near-instantaneous compression operation of performing a near-instantaneous compression for the differential data outputted by the DPCM encoding operation to reduce a number of bits in the differential data, and generating and outputting compressed differential data; and

a packet assembling operation of generating and outputting a data packet for the sending operation as the compressed block, the data packet containing a first pixel value in the data block generated by the blocking operation and the respective compressed differential data outputted by the near-instantaneous compression operation,

wherein the DPCM encoding operation comprises;

a delay operation of applying a predetermined delay amount to 1^st to (p−

1)^th pixel values in each data block generated by the blocking operation, and outputting delayed pixel values; and

a subtraction operation of calculating respective differences between 2^nd to p^th pixel values in each data block generated by the blocking operation and 1^st to (p−

1)^th delayed pixel values outputted by the delay operation to generate (p−

1) differential data as the differential data, and outputting the (p−

1) differential data for the near-instantaneous compression operation, and

wherein the near-instantaneous compression operation comprises;

a buffer operation of storing the (p−

1) differential data outputted by the DPCM encoding operation;

a level determination operation of generating the level value based on each of the (p−

1) differential data outputted by the buffer operation and outputting the level value, the level value determining a bit to be deleted from each of the (p−

1) differential data; and

a data reduction operation of deleting the bit, as determined by the level value outpuffed by the level determination operation from each differential data outputted by the buffer operation to generate (p−

1) compressed differential data as the compressed differential data, and outputting the (p−

1) compressed differential data for the packet assembling operation.