Method and device for generating 3D panoramic video streams, and videoconference method and device
First Claim
1. In a 3-dimensional depth mapping device, a method for generating overall image data of objects at multiple depths, the method comprising:
- obtaining first depth information relative to at least two different focal points of an overall image, which results in at least two different image data views, at a first depth position, to be stitched;
creating first stitched image data by stitching the at least two different image data views at the first depth position, which corresponds to one or more objects within an overall image at the first depth;
obtaining second depth information relative to the at least two different focal points of the overall image, which results in at least two different image data views, at a second depth position, to be stitched;
creating second stitched image data by stitching the at least two different image data views at the second depth position, which corresponds to one or more objects within an overall image at the second depth; and
generating synthesized image data of the one or more objects at multiple depths by combining the first stitched image data with the second stitched image data.
3 Assignments
0 Petitions
Accused Products
Abstract
A method and a device for generating 3-dimensional (3D) panoramic video streams, a videoconference method, and a videoconference device are disclosed. The method includes: obtaining depth information of at least two video images; obtaining image data in multiple depth positions from a corresponding video image according to the depth information of each video image; stitching data of the video images according to the obtained image data in multiple depth positions, and generating 3D panoramic video streams. The technical solution of the present invention provides users with high-resolution 3D panoramic seamless telepresence conference video images based on different display modes of different display devices.
-
Citations
42 Claims
-
1. In a 3-dimensional depth mapping device, a method for generating overall image data of objects at multiple depths, the method comprising:
-
obtaining first depth information relative to at least two different focal points of an overall image, which results in at least two different image data views, at a first depth position, to be stitched; creating first stitched image data by stitching the at least two different image data views at the first depth position, which corresponds to one or more objects within an overall image at the first depth; obtaining second depth information relative to the at least two different focal points of the overall image, which results in at least two different image data views, at a second depth position, to be stitched; creating second stitched image data by stitching the at least two different image data views at the second depth position, which corresponds to one or more objects within an overall image at the second depth; and generating synthesized image data of the one or more objects at multiple depths by combining the first stitched image data with the second stitched image data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A 3-dimensional (3D) panoramic videoconference method, comprising:
-
obtaining first depth information relative to at least two different focal points of an overall image, which results in at least two different image data views, at a first depth position, to be stitched; creating first stitched image data by stitching the at least two different image data views at the first depth position, which corresponds to one or more objects within an overall image at the first depth; obtaining second depth information relative to the at least two different focal points of the overall image, which results in at least two different image data views, at a second depth position, to be stitched; creating second stitched image data by stitching the at least two different image data views at the second depth position, which corresponds to one or more objects within an overall image at the second depth; wherein;
the at least two different image data views at the first and second depth positions are frames of at least two different video streams of the same site taken at a same instance in time from at least two viewpoints;generating a synthesized frame comprising the one or more objects at multiple depths by combining the first stitched image data with the second stitched image data; displaying the synthesized frame on a terminal display according to a type of the terminal display. - View Dependent Claims (12, 13, 14)
-
-
15. A device for generating overall image data of objects at multiple depths, comprising:
-
a depth information obtaining apparatus, configured to obtain first depth information relative to at least two different focal points of an overall image, which results in at least two different image data views, at a first depth position, to be stitched, and configured to obtain second depth information relative to the at least two different focal points of the overall image, which results in at least two different image data views, at a second depth position, to be stitched; a 3D panoramic video stream generating apparatus, configured to create first stitched image data by stitching the at least two different image data views at the first depth position, which corresponds to one or more objects within an overall image at the first depth, create second stitched image data by stitching the at least two different image data views at the second depth position, which corresponds to one or more objects within an overall image at the second depth, and generate synthesized image data of the one or more objects at multiple depths by combining the first stitched image data with the second stitched image data. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22, 23, 24)
-
-
25. A 3-dimensional (3D) panoramic videoconference device, comprising:
-
a depth information obtaining apparatus, configured to obtain first depth information relative to at least two different focal points of an overall image, which results in at least two different image data views, at a first depth position, to be stitched, and obtain second depth information relative to the at least two different focal points of the overall image, which results in at least two different image data views, at a second depth position, to be stitched, wherein;
the at least two different image data views at the first and second depth positions are frames of at least two different video streams of the same site taken at a same instance in time from at least two viewpoints;a 3D panoramic video stream generating apparatus, configured to create first stitched image data by stitching the at least two different image data views at the first depth position which corresponds to one or more objects within an overall image at the first depth, create second stitched image data by stitching the at least two different image data views at the second death position which corresponds to one or more objects within an overall image at the second depth, and generate a synthesized frame comprising the one or more objects at multiple depths by combining the first stitched image data with the second stitched image data; and a video image display apparatus, configured to display the synthesized frame on a terminal display according to a type of the terminal display. - View Dependent Claims (26, 27, 28)
-
-
29. A computer program product comprising computer executable instructions, which are stored on a non-transitory computer readable medium such that when executed by a computer program processor cause a 3-dimensional (3-D) depth mapping device to perform the following:
-
obtain first depth information relative to at least two different focal points of an overall image, which results in at least two different image data views, at a first depth position, to be stitched; create first stitched image data by stitching the at least two different image data views at the first depth position, which corresponds to one or more objects within an overall image at the first depth; obtain second depth information relative to the at least two different focal points of the overall image, which results in at least two different image data views, at a second depth position, to be stitched; create second stitched image data by stitching the at least two different image data views at the second depth position, which corresponds to one or more objects within an overall image at the second depth; and generate synthesized image data of the one or more objects at multiple depths by combining the first stitched image data with the second stitched image data. - View Dependent Claims (30, 31, 32, 33, 34, 35, 36, 37, 38)
-
-
39. A computer program product comprising computer executable instructions, which are stored on a non-transitory computer readable medium such that when executed by a computer program processor cause a 3-dimensional (3D) panoramic videoconference device to perform the following:
-
obtain first depth information relative to at least two different focal points of an overall image, which results in at least two different image data views, at a first depth position, to be stitched; create first stitched image data by stitching the at least two different image data views at the first depth position, which corresponds to one or more objects within an overall image at the first depth; obtain second depth information relative to the at least two different focal points of the overall image, which results in at least two different image data views, at a second depth position, to be stitched; create second stitched image data by stitching the at least two different image data views at the second depth position, which corresponds to one or more objects within an overall image at the second depth; wherein;
the at least two different image data views at the first and second depth positions are frames of at least two different video streams of the same site taken at a same instance in time from at least two viewpoints;generate a synthesized frame comprising the one or more objects at multiple depths by combining the first stitched image data with the second stitched image data; display the synthesized frame on a terminal display according to a type of the terminal display. - View Dependent Claims (40, 41, 42)
-
Specification