Coding method for motion-image data, decoding method, terminal equipment executing these, and two-way interactive system

• US 7,983,497 B2
• Filed: 01/13/2010
• Issued: 07/19/2011
• Est. Priority Date: 04/23/2004
• Status: Expired due to Fees

• Current Assignee: Sumitomo Electric Industries Limited (Sumitomo Corporation)
• Original Assignee: Sumitomo Electric Industries Limited (Sumitomo Corporation)
• Inventors: Kiya, Hitoshi, Kakii, Toshiaki, Hata, Yoichi, Maki, Hisao
• Primary Examiner(s): Ahmed; Samir A
• Assistant Examiner(s): Bayat; Ali
• Application Number:
  US12/686,993
• Publication Number:
  US 20100118935A1
• Time in Patent Office: 552 Days
• Field of Search: 382/133, 382/232, 382/233, 382/239, 382/236, 382/100, 382/240, 382/250, 382/251, 382/305, 375/240, 375/240.08, 375/240.03, 375/240.01, 375/240.24, 700/86, 700/19, 700/83, 705/14, 348/14.12
• US Class Current: 382/232
• CPC Class Codes: H04N 7/144 camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

This invention relates to a coding method for motion-image data and others effective in a special interactive environment for transmitting motion-image data with information concentrated on only a partial region of a display image as in a two-way interactive system implementing real-time two-way interaction. The coding method involves dividing an image frame forming motion-image data into a plurality of rectangular regions, and grouping each of these rectangular regions into a preset ROI and a non-ROI. These rectangular regions are sequentially compressed so that a code length of a rectangular region grouped into the ROI is larger than a code length of a rectangular region grouped into the non-ROI, thereby generating coded data of each image frame.

Claims

1. A coding method for motion-image data in which each of image frames, arranged along a time axis so as to constitute motion-image data, is sequentially and individually compressed along a time axis, the coding method comprising the steps of:

setting a virtual image frame comprised of a plurality of sub-regions, as an image frame to be coded;

allocating one selected from at least one of a plurality of sub-images obtained by dividing an image frame to be coded out of the image frames constituting the motion-image data, and a clipped image obtained from another information source different from the motion-image data, to each of the plurality of sub-regions constituting the virtual image frame; and

individually compressing each of the images allocated to the plurality of sub-regions constituting the virtual image frame, according to a coding level set for each of the plurality of sub-regions, thereby generating coded data of each virtual image frame including plural types of image information.

2. A coding method for motion-image data according to claim 1, wherein each of the plurality of sub-regions is grouped into either of a region of interest set in the virtual image frame and a region of no interest different from the region of interest, and

wherein each of the plurality of sub-regions is compressed so that a code length of a sub-region grouped into the region of interest is larger than a code length of a sub-region grouped into the region of no interest.

3. A coding method for motion-image data according to claim 2, wherein a sub-region in which a motion of an image is detected, out of the plurality of sub-regions, is grouped into the region of interest.

4. A coding method for motion-image data according to claim 1, wherein coded data of an image allocated to at least one of the plurality of sub-regions constituting the virtual image frame is further encrypted.

5. A coding method for motion-image data according to claim 1, wherein in a process of coding at least one of the plurality of sub-regions, the code length of the sub-region is 0 during a certain period of time.

6. A coding method for motion-image data according to claim 1, wherein the virtual image frame is compressed each by JPEG2000.

7. A non-transitory recording medium storing a computer program for letting a computer execute a coding method for motion-image data according to claim 1.

8. A two-way interactive system for mutually presenting an image of an interlocutor photographed, to a partner interlocutor through predetermined transmission means to implement an interaction between the interlocutor and the partner interlocutor, wherein image frames constituting motion-image data transmitted and received through the transmission means are coded by a coding method for motion-image data in which each of image frames, arranged along a time axis so as to constitute motion-image data, is sequentially and individually compressed along a time axis, the coding method comprising the steps of:

setting a virtual image frame comprised of a plurality of sub-regions, as an image frame to be coded;

allocating one selected from at least one of a plurality of sub-images obtained by dividing an image frame to be coded out of the image frames constituting the motion-image data, and a clipped image obtained from another information source different from the motion-image data, to each of the plurality of sub-regions constituting the virtual image frame; and

individually compressing each of the images allocated to the plurality of sub-regions constituting the virtual image frame, according to a coding level set for each of the plurality of sub-regions, thereby generating coded data of each virtual image frame including plural types of image information.

9. A terminal equipment applicable to a two-way interactive system for mutually presenting an image of an interlocutor photographed, to a partner interlocutor through predetermined transmission means to implement an interaction between the interlocutor and the partner interlocutor, comprising at least a display device for displaying an image of the partner interlocutor, and an image taking unit for taking the image of the interlocutor located in front of the display device, the terminal equipment comprising:

(1) a controller for implementing a coding method for motion-image data in which each of image frames, arranged along a time axis so as to constitute motion-image data, is sequentially and individually compressed along a time axis, the coding method comprising the steps of;

setting a virtual image frame comprised of a plurality of sub-regions, as an image frame to be coded;

allocating one selected from at least one of a plurality of sub-images obtained by dividing an image frame to be coded out of the image frames constituting the motion-image data, and a clipped image obtained from another information source different from the motion-image data, to each of the plurality of sub-regions constituting the virtual image frame; and

individually compressing each of the images allocated to the plurality of sub-regions constituting the virtual image frame, according to a coding level set for each of the plurality of sub-regions, thereby generating coded data of each virtual image frame including plural types of image information; and

(2) an input/output unit for sending coded data compressed by the controller, to the transmission means.

10. A terminal equipment of the two-way interactive system according to claim 9, further comprising input means for retrieving information about compression levels of the sub-regions and presence/absence of encryption thereof.

11. A terminal equipment of the two-way interactive system according to claim 9, wherein the controller (1) receives image data through the input/output unit, the image data being compressed such that, in a process of coding at least one of the plurality of sub-regions, the code length of the sub-region is 0 during a certain period of time and being transmitted to the transmission means, (2) decodes coded data of each of the sub-regions constituting the image data, and (3) combines the decoded sub-regions with an image prepared instead of the sub-region having the code length of 0, to generate display image data.