Method, apparatus and system for processing depth-related information
First Claim
1. A method of processing first depth-related information associated with an image sequence comprising:
- mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth-related information using a first estimate of a characteristic of a distribution of first depth-related information associated with at least one image from the shot, the mapping comprising;
determining a range of interest of the first depth-related information based at least in part by the first estimate, wherein an amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of said shot; and
allocating said determined range of interest of said first depth-related information onto a full range of interest of said second depth related information.
1 Assignment
0 Petitions
Accused Products
Abstract
The invention relates to a method, apparatus and system for processing first depth-related information associated with an image sequence. The method of processing comprises mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth-related information using a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the mapping adapting the first depth-related information by enhancing the dynamic range of a range of interest of first depth-related information defined at least in part by the first estimate, and the amount of variation in the mapping for respective images in temporal proximity in the shot being limited.
12 Citations
23 Claims
-
1. A method of processing first depth-related information associated with an image sequence comprising:
-
mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth-related information using a first estimate of a characteristic of a distribution of first depth-related information associated with at least one image from the shot, the mapping comprising; determining a range of interest of the first depth-related information based at least in part by the first estimate, wherein an amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of said shot; and allocating said determined range of interest of said first depth-related information onto a full range of interest of said second depth related information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 23)
-
-
12. An apparatus for processing first depth-related information associated with an image sequence, comprising mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth-related information, the apparatus comprising:
-
processing means arranged to; map the first depth-related information of respective images of a shot of the image sequence on the corresponding second depth-related information using a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the mapping comprising; determining a range of interest of the first depth-related information based at least in part by the first estimate, wherein an amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of said shot allocating said determined range of interest of said first depth-related information on a full range of interest of said second depth related information.
-
-
13. A system for processing first depth-related information associated with an image sequence, comprising mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth related information, the system comprising:
-
a first apparatus comprising; obtaining means arranged to obtain shot information classifying multiple sequential images from the image sequence as a shot obtaining means arranged to obtain a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot; transmitter means arranged to send the shot information and the first estimate over a network; and a second apparatus comprising; receiver means arranged to receive the shot information and the first estimate-from a network and processing means arranged to map the first depth-related information of respective images of the shot on the corresponding second depth-related information using the first estimate, the mapping adapting the first depth-related information by enhancing the dynamic range of a range of interest of first depth-related information defined at least in part by the first estimate, and wherein the amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of said shot.
-
-
14. A non-transitory computer readable medium comprising:
-
mapping first depth-related information associated with an image-sequence; forming shot information by classifying multiple images from the image sequence as a shot; creating a first estimate of a characteristic of the distribution of first depth-related information values associated with at least one image from the shot, the first depth-related information of respective images of the shot mapped onto a corresponding second depth-related information using the first estimate, the mapping adapting the first depth-related information by enhancing the dynamic range of a range of interest of the first depth-related information defined at least by the first estimate, and wherein the amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of said shot.
-
-
15. A computer program product stored on a tangible computer readable medium, said program product to be loaded into a computer arrangement, said product comprising instructions, which when accessed by the computer arrangement causes the computer arrangement to:
-
map said first depth-related information of respective images of a shot of the image sequence on corresponding depth-related information on corresponding second depth-related information using a first estimate, the mapping comprising; determining a range of interest of the first depth-related information based at least in part by the first estimate, wherein an amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of said shot; and
allocating said determined range of interest of said first depth-related information onto a full range of interest of said second depth related information.
-
-
16. An apparatus for processing first depth-related information associated with an image sequence, comprising mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth-related information, the apparatus comprising:
-
processing means arranged to; map the first depth-related information of respective images of a shot of the image sequence on the corresponding second depth-related information using a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the mapping comprising; determining a range of interest of the first depth-related information based at least in part by the first estimate, wherein an amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of the shot, and allocating said determined range of interest of said first depth-related information onto a full range of interest of said second depth related information.
-
-
17. An apparatus for processing first depth-related information associated with an image sequence, comprising mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth-related information, the apparatus comprising:
processing means arranged to; map the first depth-related information of respective images of a shot of the image sequence on the corresponding second depth-related information using a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the mapping adapting the first depth-related information by enhancing a dynamic range of a range of interest of first depth-related information defined at least in part by the first estimate, and wherein the amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of said shot, and wherein the maximum amount of variation in the respective mapping used for adjacent images within the shot is upperbounded by the predetermined threshold.
-
18. An apparatus for processing first depth-related information associated with an image sequence, comprising mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth related information, the apparatus comprising:
processing means arranged to; map the first depth-related information of respective images of a shot of the image sequence on the corresponding second depth-related information using a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the mapping adapting the first depth-related information by enhancing the dynamic range of a range of interest of first depth-related information defined at least in part by the first estimate, and wherein the amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of said shot, and wherein the first estimate represents an estimate of a characteristic of the distribution of first depth-related information for all images in the shot.
-
19. An apparatus for processing first depth-related information associated with an image sequence, comprising mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth related information, the apparatus comprising:
processing means arranged to; map the first depth-related information of respective images of a shot of the image sequence on the corresponding second depth-related information using a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the mapping adapting the first depth-related information by enhancing the dynamic range of a range of interest of first depth-related information defined at least in part by the first estimate, and wherein the amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of the shot, and wherein the first estimate is based on weighted first depth-related information associated with at least one image from the shot, the weighting factors based on reliability information indicative of the reliability of the first depth-related information.
-
20. An apparatus for processing first depth-related information associated with an image sequence, comprising mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth related information, the apparatus comprising:
-
processing means arranged to; map the first depth-related information of respective images of a shot of the image sequence on the corresponding second depth-related information using a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the mapping adapting the first depth-related information by enhancing the dynamic range of a range of interest of first depth-related information defined at least in part by the first estimate, and wherein an amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of the shot, and obtain classifying information for the shot; and adapt the mapping for respective images of the shot based on the classifying information.
-
-
21. An apparatus for processing first depth-related information associated with an image sequence, comprising mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth related information, the apparatus comprising:
processing means arranged to; map the first depth-related information of respective images of a shot of the image sequence on the corresponding second depth-related information using a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the mapping adapting the first depth-related information by enhancing the dynamic range of a range of interest of first depth-related information defined at least in part by the first estimate, and wherein the amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of the shot, and wherein the first depth-related information used for determining the first estimate are located in a first image region, and reduce a probability of window violations using a second estimate, the second estimate being an estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the first depth-related information used for determining the second estimate located in a second image region near an image border.
-
22. An apparatus for processing first depth-related information associated with an image sequence, comprising mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth-related information, the apparatus comprising:
processing means arranged to; map the first depth-related information of respective images of a shot of the image sequence on the corresponding second depth-related information using a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the mapping adapting the first depth-related information by enhancing the dynamic range of a range of interest of first depth-related information defined at least in part by the first estimate, and wherein the amount of variation in the mapping for respective images in temporal proximity in the shot is based on a predetermined threshold value, said threshold value being determined by a type of said shot, and reduce a probability of window violations by contracting the range of first depth-related information produced by the mapping.
Specification