Decoding apparatus, decoding method, distribution method, and system for transmission and reception of images

• US 10,327,007 B2
• Filed: 12/19/2014
• Issued: 06/18/2019
• Est. Priority Date: 12/27/2013
• Status: Active Grant

• Current Assignee: Sun Patent Trust
• Original Assignee: Sun Patent Trust
• Inventors: Terada, Kengo, Sasai, Hisao, Toma, Tadamasa, Iguchi, Noritaka, Koashi, Yui
• Primary Examiner(s): Nawaz, Talha M
• Application Number:
  US14/578,111
• Publication Number:
  US 20150189300A1
• Time in Patent Office: 1,642 Days
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/52 by predictive encoding

Abstract

There is provided a decoding method for decoding an image, the method including: transmitting a request for an image to an external apparatus; receiving a coded signal corresponding to the image that has been requested and including a first signal and a second signal, and storing the coded signal in a storage; decoding the first signal and the second signal included in the coded signal; and displaying a first image decoded from the first signal in a first region of a screen, and displaying a second image decoded from the second signal in a second region of the screen. The second signal is a signal that has been selected by the external apparatus for a decoding apparatus from among a plurality of candidates for the second signal.

Claims

1. A decoding apparatus for decoding an image, the decoding apparatus comprising:

a processing circuit;

a storage connected to the processing circuit; and

a communication circuit connected to the storage,

the communication circuit being configured to

transmit a request for the image to an external apparatus,

receive a coded signal corresponding to the image that has been requested and including a first signal and a second signal, and store the coded signal in the storage,

the processing circuit being configured to

decode the first signal and the second signal included in the coded signal that has been read from the storage, and

display a displayed image on a screen, the displayed image including (i) a first image decoded from the first signal in a first region of the screen and (ii) a second image decoded from the second signal in a second region of the screen,

wherein the displayed image is split into a plurality of tiles,

wherein (i) the first signal includes a first group of tiles, (ii) the plurality of tiles included in the displayed image includes the first group of tiles, and (iii) motion prediction for the first group of tiles is constrained such that no pixel outside the first group of tiles is used by the processing circuit when the first signal is decoded,

wherein (i) the second signal includes a second group of tiles, (ii) the plurality of tiles included in the displayed image includes the second group of tiles, (iii) the second group of tiles is different from the first group of tiles, and (iv) motion prediction for the second group of tiles is constrained such that no pixel outside the second group of tiles is used by the processing circuit when the second signal is decoded, and

wherein in response to an instruction from a user to delete the second image from the second region of the screen during display of the displayed image, the processing circuit changes an assignment of a second tile in the second region of the screen such that a first replacement tile is decoded using the first signal and used as a replacement for the second tile without decoding all of the plurality of tiles, the first replacement tile being included in the plurality of tiles and being assigned to the first group of tiles.

2. The decoding apparatus according to claim 1, wherein

the first image forms part of the image that has been requested, and corresponds to the first region, and

one or more tiles among the plurality of tiles are coded so as to make the coded signal include the second signal that corresponds to the second region and that is obtained by replacing part of the image that has been requested with the second image and coding the second image.

3. The decoding apparatus according to claim 2, wherein

the first image is the image that has been requested, and the second image is information that is associated with the first image and that includes at least either one of text data and image data.

4. The decoding apparatus according to claim 3, wherein

the communication circuit is configured to

further transmit at least one of (i) user information specific to a user of the decoding apparatus, (ii) apparatus information specific to the decoding apparatus, and (iii) position information about the decoding apparatus, and

receive the second signal that has been selected by the external apparatus from among the plurality of candidates in accordance with the at least one of (i) the user information, (ii) the apparatus information, and (iii) the position information, which has been transmitted.

5. The decoding apparatus according to claim 4, wherein

the processing circuit is configured to display the second image that has been converted so as to match the second region, a position of the second region in the screen and a size of the second region having been set in advance.

6. The decoding apparatus according to claim 5, wherein

the processing circuit is configured to replace the second image, in a case where a size of the second image exceeds a predetermined value, with any of (i) a third image that includes text information extracted from the second image and that has a size equal to or less than the predetermined value, (ii) a predetermined fourth image, and (iii) part of the first image, the part corresponding to the second region, and display an image after replacement in the second region.

7. The decoding apparatus according to claim 4, wherein

the communication circuit is configured to further receive region information that indicates at least one of a position of the second region in the screen and a size of the second region, and

the processing circuit is configured to display the second image in the second region that has been set in accordance with the region information.

8. The decoding apparatus according to claim 7, wherein

the second region is smaller than the first region, and overlaps part of the first region.

13. The decoding apparatus according to claim 1, wherein

only reference to a pixel inside the first group of tiles is allowed in the first signal included in the coded signal and in an image signal that is temporally different from the first signal included in the coded signal, and

only reference to a pixel inside the second group of tiles is allowed in the second signal included in the coded signal and in an image signal that is temporally different from the second signal included in the coded signal.

14. The decoding apparatus according to claim 1, wherein

in response to an instruction from a user to move the second image from the second region of the screen to the first region of the screen during display of the displayed image, the processing circuit (i) changes an assignment of a first tile in the first region of the screen such that a second replacement tile is decoded using the second signal and used as a replacement for the first tile without decoding all of the plurality of tiles, the second replacement tile being included in the plurality of tiles and being assigned to the second group of tiles and (ii) changes the assignment of the second tile in the second region of the screen such that the first replacement tile is decoded using the first signal and used as a replacement for the second tile without decoding all of the plurality of tiles, the first replacement tile being included in the plurality of tiles and being assigned to the first group of tiles.

9. A decoding method for decoding an image, the method comprising:

transmitting a request for the image to an external apparatus;

receiving a coded signal corresponding to the image that has been requested and including a first signal and a second signal, and storing the coded signal in a storage;

decoding the first signal and the second signal included in the coded signal; and

displaying a displayed image on a screen, the displayed image including (i) a first image decoded from the first signal in a first region of the screen and (ii) a second image decoded from the second signal in a second region of the screen,

wherein the displayed image is split into a plurality of tiles,

wherein (i) the first signal includes a first group of tiles, (ii) the plurality of tiles included in the displayed image includes the first group of tiles, and (iii) motion prediction for the first group of tiles is constrained such that no pixel outside the first group of tiles is used by the processing circuit when the first signal is decoded,

wherein (i) the second signal includes a second group of tiles, (ii) the plurality of tiles included in the displayed image includes the second group of tiles, (iii) the second group of tiles is different from the first group of tiles, and (iv) motion prediction for the second group of tiles is constrained such that no pixel outside the second group of tiles is used by the processing circuit when the second signal is decoded, and

wherein in response to an instruction from a user to delete the second image from the second region of the screen during display of the displayed image, an assignment of a second tile in the second region of the screen is changed such that a first replacement tile is decoded using the first signal and used as a replacement for the second tile without decoding all of the plurality of tiles, the first replacement tile being included in the plurality of tiles and being assigned to the first group of tiles.

15. The decoding method according to claim 9, wherein

in response to an instruction from a user to move the second image from the second region of the screen to the first region of the screen during display of the displayed image, (i) an assignment of a first tile in the first region of the screen is changed such that a second replacement tile is decoded using the second signal and used as a replacement for the first tile without decoding all of the plurality of tiles, the second replacement tile being included in the plurality of tiles and being assigned to the second group of tiles and (ii) the assignment of the second tile in the second region of the screen is changed such that the first replacement tile is decoded using the first signal and used as a replacement for the second tile without decoding all of the plurality of tiles, the first replacement tile being included in the plurality of tiles and being assigned to the first group of tiles.

10. A distribution method for distributing an image, the method comprising:

receiving a request for the image from an external terminal;

selecting a first image corresponding to the image that has been requested, and a second image that includes at least either one of text data and image data from among a plurality of candidates for the second image, for the external terminal; and

transmitting to the external terminal a coded signal including a first signal and a second signal,

wherein (i) the first signal includes a first group of tiles, (ii) the plurality of tiles included in the displayed image includes the first group of tiles, and (iii) motion prediction for the first group of tiles is constrained such that no pixel outside the first group of tiles is used by the processing circuit when the first signal is decoded,

wherein (i) the second signal includes a second group of tiles, (ii) the plurality of tiles included in the displayed image includes the second group of tiles, (iii) the second group of tiles is different from the first group of tiles, and (iv) motion prediction for the second group of tiles is constrained such that no pixel outside the second group of tiles is used by the processing circuit when the second signal is decoded, and

wherein in response to an instruction from a user to delete the second image from the second region of the screen during display of the displayed image, an assignment of a second tile in the second region of the screen is changed such that a first replacement tile is decoded using the first signal and used as a replacement for the second tile without decoding all of the plurality of tiles, the first replacement tile being included in the plurality of tiles and being assigned to the first group of tiles.

16. The distribution method according to claim 10, wherein

in response to an instruction from a user to move the second image from the second region of the screen to the first region of the screen during display of the displayed image, (i) an assignment of a first tile in the first region of the screen is changed such that a second replacement tile is decoded using the second signal and used as a replacement for the first tile without decoding all of the plurality of tiles, the second replacement tile being included in the plurality of tiles and being assigned to the second group of tiles and (ii) the assignment of the second tile in the second region of the screen is changed such that the first replacement tile is decoded using the first signal and used as a replacement for the second tile without decoding all of the plurality of tiles, the first replacement tile being included in the plurality of tiles and being assigned to the first group of tiles.

11. A decoding apparatus for decoding an image, comprising:

a transmitting unit configured to transmit a request for the image to an external apparatus;

a receiving unit configured to receive a coded signal corresponding to the image that has been requested and including a first signal and a second signal, and store the coded signal in a storage;

a decoding unit configured to decode the first signal and the second signal included in the coded signal; and

a display unit configured to display a displayed image on a screen, the displayed image including (i) a first image decoded from the first signal in a first region of the screen and (ii) a second image decoded from the second signal in a second region of the screen,

wherein the displayed image is split into a plurality of tiles,

wherein (i) the first signal includes a first group of tiles, (ii) the plurality of tiles included in the displayed image includes the first group of tiles, and (iii) motion prediction for the first group of tiles is constrained such that no pixel outside the first group of tiles is used by the processing circuit when the first signal is decoded,

wherein (i) the second signal includes a second group of tiles, (ii) the plurality of tiles included in the displayed image includes the second group of tiles, (iii) the second group of tiles is different from the first group of tiles, and (iv) motion prediction for the second group of tiles is constrained such that no pixel outside the second group of tiles is used by the processing circuit when the second signal is decoded, and

wherein in response to an instruction from a user to delete the second image from the second region of the screen during display of the displayed image, an assignment of a second tile in the second region of the screen is changed such that a first replacement tile is decoded using the first signal and used as a replacement for the second tile without decoding all of the plurality of tiles, the first replacement tile being included in the plurality of tiles and being assigned to the first group of tiles.

17. The decoding apparatus according to claim 11, wherein

in response to an instruction from a user to move the second image from the second region of the screen to the first region of the screen during display of the displayed image, (i) an assignment of a first tile in the first region of the screen is changed such that a second replacement tile is decoded using the second signal and used as a replacement for the first tile without decoding all of the plurality of tiles, the second replacement tile being included in the plurality of tiles and being assigned to the second group of tiles and (ii) the assignment of the second tile in the second region of the screen is changed such that the first replacement tile is decoded using the first signal and used as a replacement for the second tile without decoding all of the plurality of tiles, the first replacement tile being included in the plurality of tiles and being assigned to the first group of tiles.

12. A system comprising:

a first apparatus that decodes an image; and

a second apparatus that stores a coded signal obtained by coding the image,

the first apparatus including a first processing circuit, a first storage connected to the first processing circuit, and a first communication circuit connected to the first storage,

the first communication circuit being configured to

transmit a request for the image to the second apparatus,

receive the coded signal corresponding to the image that has been requested and including a first signal and a second signal, and store the coded signal in the first storage,

the first processing circuit being configured to

decode the first signal and the second signal included in the coded signal that has been read from the first storage, and

display a displayed image on a screen, the displayed image including (i) a first image decoded from the first signal in a first region of the screen and (ii) a second image decoded from the second signal in a second region of the screen,

the second apparatus including a second processing circuit, a second storage connected to the second processing circuit, and a second communication circuit connected to the second storage,

the second communication circuit being configured to

receive the request for the image from the first apparatus,

select the first image corresponding to the image that has been requested, and the second image that includes at least either one of text data and image data from among a plurality of candidates for the second image, for the first apparatus, and

transmit to the first apparatus the coded signal including the first signal and the second signal,

wherein (i) the first signal includes a first group of tiles, (ii) the plurality of tiles included in the displayed image includes the first group of tiles, and (iii) motion prediction for the first group of tiles is constrained such that no pixel outside the first group of tiles is used by the processing circuit when the first signal is decoded,

wherein (i) the second signal includes a second group of tiles, (ii) the plurality of tiles included in the displayed image includes the second group of tiles, (iii) the second group of tiles is different from the first group of tiles, and (iv) motion prediction for the second group of tiles is constrained such that no pixel outside the second group of tiles is used by the processing circuit when the second signal is decoded, and

wherein in response to an instruction from a user to delete the second image from the second region of the screen during display of the displayed image, an assignment of a second tile in the second region of the screen is changed such that a first replacement tile is decoded using the first signal and used as a replacement for the second tile without decoding all of the plurality of tiles, the first replacement tile being included in the plurality of tiles and being assigned to the first group of tiles.

18. The system according to claim 12, wherein

in response to an instruction from a user to move the second image from the second region of the screen to the first region of the screen during display of the displayed image, (i) an assignment of a first tile in the first region of the screen is changed such that a second replacement tile is decoded using the second signal and used as a replacement for the first tile without decoding all of the plurality of tiles, the second replacement tile being included in the plurality of tiles and being assigned to the second group of tiles and (ii) the assignment of the second tile in the second region of the screen is changed such that the first replacement tile is decoded using the first signal and used as a replacement for the second tile without decoding all of the plurality of tiles, the first replacement tile being included in the plurality of tiles and being assigned to the first group of tiles.