IMAGE TRANSMISSION METHOD AND IMAGE TRANSMISSION APPARATUS

• US 20140347466A1
• Filed: 01/29/2013
• Published: 11/27/2014
• Est. Priority Date: 02/08/2012
• Status: Abandoned Application

• Current Assignee: Fuji Company Limited
• Original Assignee: Fuji Machine Manufacturing Company Limited
• Inventors: Jindo, Takahiro, Hirano, Atsunori, Hirota, Shigemoto, Yamashita, Yasuhiro, Nagasaka, Nobuo
• Application Number:
  US14/376,756
• Publication Number:
  US 20140347466A1
• Time in Patent Office: Days
• US Class Current: 348/87
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 25/443 by reading pixels from selected 2D regions of the array, e.g. for windowing or digital zooming
• CPC Class Codes: H04N 25/75 Circuitry for providing, modifying or processing image signals from the pixel array
• CPC Class Codes: H04N 25/76 Addressed sensors, e.g. MOS or CMOS sensors
• CPC Class Codes: H05K 1/0269 for visual or optical inspection

Abstract

An image transmission method, from an image sensor which collects a fixed number of pixel data items obtained by a plurality of imaging elements into a data block, and outputs the pixel data items, including a transmission region setting step of setting an interest region by using a unit lower than the fixed number, a region extension step of extending the interest region to obtain an extension interest region in which the data block is represented as a unit and obtaining extension ranges from the interest region to the extension interest region, an imaging step of performing imaging with the image sensor, an output step of outputting the data block included in the extension interest region from the image sensor, and an extension range erasing step of erasing pixel data of the extension ranges from the output data block so as to obtain an image of the interest region.

Claims

1. An image transmission method comprising:

setting an interest region, which is a transmission target, in an imaging region defined by a first unit of at least one pixel data item that is less than a fixed number of pixel data items obtained by a plurality of imaging elements of an image sensor for a data block;

extending the interest region so as to obtain an extension interest region defined by the fixed number of pixel data items of the data block as a second unit, and obtaining an extension range from the interest region to the extension interest region;

imaging with the image sensor, obtaining pixel data using respective imaging elements which capture an image of the imaging region, and collecting pixel data items included in the extension interest region into the data block;

outputting the data block included in the extension interest region from the image sensor; and

erasing pixel data of the extension range from the output data block so as to obtain the image of the interest region.

2. The image transmission method according to claim 1, further comprising:

converting a plurality of extension interest regions into non-overlapping regions which do not overlap each other, subsequently to the extending step, when a plurality of interest regions are set in the setting step, and at least one of the plurality of extension interest regions obtained in the extending step overlap each other,

wherein, in the output step, data blocks included in the non-overlapping regions are output instead of the extension interest regions.

3. The image transmission method according to claim 1,

wherein, in the image sensor,

the plurality of imaging elements are arranged in a two-dimensional manner such that a plurality of imaging elements are linearly arranged in an X axis direction on X-Y orthogonal coordinate axes and a plurality of imaging element rows are arranged in a Y axis direction,

the plurality of imaging elements which are linearly arranged in the X axis direction are divided every fixed number so as to form a block element group, and

pixel data of the block element group is set as the data block,

wherein, in the setting step, a rectangular interest region parallel to an X axis and a Y axis is set,

wherein, in the extending step, the rectangular interest region is extended to the X axis direction so that a rectangular extension interest region is obtained, and

wherein, in the outputting step,

a Y axis coordinate value of an imaging element which is an output target is initially fixed to a minimum value of the extension interest region,

an X axis coordinate value is changed from one of the minimum value and a maximum value of the extension interest region to the other value so that a data block of a first row is output,

then a Y axis coordinate value of an imaging element which is the output target is increased by one imaging element so as to be fixed,

an X axis coordinate value is changed from one of the minimum value and the maximum value of the extension interest region to the other value so that a data block of a second row is output, and

a data block of each row is repeatedly output until a Y axis coordinate value of an imaging element which is the output target becomes a maximum value of the extension interest region so that all data blocks included in the rectangular extension interest region are output.

4. The image transmission method according to claim 3, further comprising:

converting a plurality of rectangular extension interest regions into rectangular non-overlapping regions which do not overlap each other and are not continuously located in the X axis direction, subsequently to the extending step, when a plurality of rectangular interest regions are set in the setting step, and at least one of the plurality of rectangular extension interest regions obtained in the extending step overlap each other,

wherein, in the output step, all data blocks included in the rectangular non-overlapping regions are output instead of the rectangular extension interest regions.

5. The image transmission method according to claim 4,

wherein the converting step includes:

subdividing the imaging region into a plurality of small regions with a lattice shape by using all X axis coordinate values and Y axis coordinate values indicating boundaries of the plurality of rectangular extension interest regions;

sorting each of the small regions into a necessary small region inside the extension interest region and an unnecessary small region outside the extension interest region;

connecting a plurality of necessary small regions which are continuously located in the X axis direction so as to replace the plurality of necessary small regions with new necessary small regions;

connecting a plurality of necessary small regions which are continuously located in the Y axis direction and have the same X axis coordinate values indicating the boundaries so as to replace the plurality of necessary small regions with new necessary small regions; and

using the nee necessary small regions as the rectangular non-overlapping regions.

6. An image transmission apparatus comprising:

an image sensor that captures an image of an imaging region of a subject by using a plurality of imaging elements, collects a fixed number of pixel data items obtained by the respective imaging elements into a data block, and outputs the pixel data items for each data block;

a transmission region setting device that sets an interest region which is a transmission target in the imaging region defined by a first unit of at least one pixel data item that is less than the fixed number in relation to the pixel data items obtained by the plurality of imaging elements which capture the image of the imaging region;

a controller configured to;

extend the interest region so as to obtain an extension interest region defined by the fixed number of pixel data items of the data block as a second unit, and obtain an extension range from the interest region to the extension interest region, and

output the data block included in the extension interest region from the image sensor; and

an extension region erasing device configured to erase pixel data of the extension range from the output data block so as to obtain an image of the interest region.

7. The image transmission apparatus according to claim 6, wherein the controller is configured to:

subsequently to the region extension, convert a plurality of extension interest regions into non-overlapping regions which do not overlap each other, when a plurality of interest regions are set by the transmission region setting device, and at least one of the plurality of extension interest regions overlap each other, and

output data blocks included in the non-overlapping regions instead of the extension interest regions.

8. The image transmission apparatus according to claim 6,

wherein the image sensor includes:

the plurality of imaging elements arranged in a two-dimensional manner such that a plurality of imaging elements are linearly arranged in an X axis direction on X-Y orthogonal coordinate axes and a plurality of imaging element rows are arranged in a Y axis direction;

a multiplexer that changes and selects block element groups obtained by dividing the plurality of imaging elements which are linearly arranged in the X axis direction in a unit of the fixed number; and

AD converters, with the same number as the fixed number, that digitalize pixel data of each image element of a block element group selected by the multiplexer,

wherein the transmission region setting device sets a rectangular interest region parallel to an X axis and a Y axis, and

wherein the controller is configured to;

extend the rectangular interest region to the X axis direction so as to obtain a rectangular extension interest region,

fix a Y axis coordinate value of an imaging element which is an initial output target to a minimum value of the extension interest region,

digitalize and output pixel data of each image element of a block element group of a first row by using the AD converter,

increase and fix a Y axis coordinate value of an imaging element which is the next output target by one imaging element to a certain value,

digitalize and output pixel data of each image element of a block element group of a second row by using the AD converter, and

repeatedly output pixel data of each image element of a block element group of each row until a Y axis coordinate value of an imaging element which is the output target becomes a maximum value of the extension interest region so that all data blocks included in the rectangular extension interest region are output.

9. The image transmission apparatus according to claim 8, wherein the controller is configured to:

subsequently to the region extension, convert a plurality of rectangular extension interest regions into rectangular non-overlapping regions which do not overlap each other and are not continuously located in the X axis direction, when a plurality of rectangular interest regions are set by the transmission region setting device, and at least one of the plurality of rectangular extension interest regions overlap each other, and

output all data blocks included in the rectangular non-overlapping regions instead of the rectangular extension interest regions.

10. The image transmission apparatus according to claim 6, wherein the extension region erasing device is a field programmable gate array.

11. The image transmission apparatus according to claim 7, wherein the extension region erasing device is a field programmable gate array.

12. The image transmission apparatus according to claim 8, wherein the extension region erasing device is a field programmable gate array.

13. The image transmission apparatus according to claim 9, wherein the extension region erasing device is a field programmable gate array.

14. An image transmission apparatus comprising:

image sensing means for capturing an image of an imaging region of a subject by using a plurality of imaging elements, collecting a fixed number of pixel data items obtained by the respective imaging elements into a data block, and outputting the pixel data items for each data block;

transmission region setting means for setting an interest region which is a transmission target in the imaging region defined by a first unit of at least one pixel data item that is less than the fixed number in relation to the pixel data items obtained by the plurality of imaging elements which capture the image of the imaging region;

region extension means for extending the interest region so as to obtain an extension interest region defined by the fixed number of pixel data items of the data block as a second unit, and obtain an extension range from the interest region to the extension interest region;

output means for outputting the data block included in the extension interest region from the image sensor; and

extension region erasing means for erasing pixel data of the extension range from the output data block so as to obtain an image of the interest region.