Stereo viewing
First Claim
1. A method, comprising:
- decoding both active and passive source video signals that have been differently encoded according to a viewing angle of a user with a visible region that was captured by one or more active image sources being encoded in higher quality than one or more regions not currently visible that were captured by one or more passive image sources,determining head orientation of a user to obtain a first head orientation,selecting a first image source, a second image source and a third image source, from three or more image sources, based on said first head orientation, said first and second image source forming a stereo image source,rendering a first target image for one eye of the user using decoded video signals from said first image source and a second target image for another eye of the user using decoded video signals from said second image source,determining head orientation of said user to obtain a second head orientation,selecting said second image source and the third image source based on said second head orientation, said second and third image source forming a stereo image source,rendering a third target image for one eye of the user using decoded video signals from said second image source and a fourth target image for another eye of the user using decoded video signals from said third image source,stitching at least a part of an image from the third image source with at least one of the first target image and the second target image, andstitching at least a part of an image from the third image source with at least one of the third target image and the fourth target image.
1 Assignment
0 Petitions
Accused Products
Abstract
The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user'"'"'s eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.
48 Citations
20 Claims
-
1. A method, comprising:
-
decoding both active and passive source video signals that have been differently encoded according to a viewing angle of a user with a visible region that was captured by one or more active image sources being encoded in higher quality than one or more regions not currently visible that were captured by one or more passive image sources, determining head orientation of a user to obtain a first head orientation, selecting a first image source, a second image source and a third image source, from three or more image sources, based on said first head orientation, said first and second image source forming a stereo image source, rendering a first target image for one eye of the user using decoded video signals from said first image source and a second target image for another eye of the user using decoded video signals from said second image source, determining head orientation of said user to obtain a second head orientation, selecting said second image source and the third image source based on said second head orientation, said second and third image source forming a stereo image source, rendering a third target image for one eye of the user using decoded video signals from said second image source and a fourth target image for another eye of the user using decoded video signals from said third image source, stitching at least a part of an image from the third image source with at least one of the first target image and the second target image, and stitching at least a part of an image from the third image source with at least one of the third target image and the fourth target image.
-
-
2. An apparatus comprising at least one processor, and memory including computer program code, the memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least:
-
decode both active and passive source video signals that have been differently encoded according to a viewing angle of a user with a visible region that was captured by one or more active image sources being encoded in higher quality than one or more regions not currently visible that were captured by one or more passive image sources, determine head orientation of a user to obtain a first head orientation, select a first image source, a second image source and a third image source, from three or more image sources, based on said first head orientation, said first and second image source forming a stereo image source, render a first target image for one eye of the user using decoded video signals from said first image source and a second target image for another eye of the user using decoded video signals from said second image source, determine head orientation of said user to obtain a second head orientation, select said second image source and the third image source based on said second head orientation, said second and third image source forming a stereo image source, render a third target image for one eye of the user using decoded video signals from said second image source and a fourth target image for another eye of the user using decoded video signals from said third image source, stitch at least a part of an image from the third image source with at least one of the first target image and the second target image, and stitch at least a part of an image from the third image source with at least one of the third target image and the fourth target image. - View Dependent Claims (3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. An apparatus comprising at least one processor, and memory including computer program code, the memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least:
-
decode both active and passive source video signals that have been differently encoded according to a viewing angle of a user with a visible region that was captured by one or more active image sources being encoded in higher quality than one or more regions not currently visible that were captured by one or more passive image sources, determine head orientations of a user for forming a stereo video sequence of a scene; select a first image source, a second image source and a third image source, from three or more image sources, based on said head orientations; render said stereo video sequence by rendering an image sequence for the left eye of the user using decoded video signals from said first image source and said second image source and an image sequence for the right eye of the user using decoded video signals from said second image source and said third image source, wherein said second image source is used to render different areas of said scene for the left and right eyes of the user in each stereo frame of said video sequence, wherein the stereo video sequence is rendered by rendering a first target image for the left eye of the user using decoded video signals from said first image source and a second target image for the right eye of the user using decoded video signals from said second image source and rendering a third target image for the left eye of the user using decoded video signals from said second image source and a fourth target image for the right eye of the user using decoded video signals from said third image source; stitch at least a part of an image from the third image source with at least one of the first target image and the second target image, and stitch at least a part of an image from the third image source with at least one of the third target image and the fourth target image.
-
-
20. A computer program product embodied on a non-transitory computer readable medium, comprising computer program code configured to, when executed on at least one processor, cause an apparatus or a system to:
-
decode both active and passive source video signals that have been differently encoded according to a viewing angle of a user with a visible region that was captured by one or more active image sources being encoded in higher quality than one or more regions not currently visible that were captured by one or more passive image sources, determine head orientation of a user to obtain a first head orientation, select a first image source, a second image source and a third image source based on said first head orientation, said first and second image source forming a stereo image source, render a first target image for one eye of the user using decoded video signals from said first image source and a second target image for another eye of the user using decoded video signals from said second image source, determine head orientation of said user to obtain a second head orientation, select said second image source and the third image source based on said second head orientation, said second and third image source forming a stereo image source, render a third target image for one eye of the user using decoded video signals from said second image source and a fourth target image for another eye of the user using decoded video signals from said third image source, stitch at least a part of an image from the third image source with at least one of the first target image and the second target image, and stitch at least a part of an image from the third image source with at least one of the third target image and the fourth target image.
-
Specification