METHOD AND APPARATUS FOR IMAGE PROCESSING IN AUGMENTED REALITY SYSTEMS
First Claim
1. A method for depth and color camera image synchronization, the method comprising:
- obtaining a plurality of input images comprising a first image type and a second image type different from the first image type, wherein an image type is either a depth camera image type or color camera image type, wherein each image type is unsynchronized with respect to images of other types, and wherein each of the plurality of input images are without identification of an input image'"'"'s actual creation time;
selecting, from input images of the first image type, a target image;
selecting, from input images of the second image type, a comparison image;
determining whether the comparison image is compatible for synchronization with the target image;
in response to a determination that the comparison image is compatible for synchronization with the target image, identifying the target image and the comparison image as a synchronized image pair; and
processing the synchronized image pair together for use in an augmented reality output.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed are a system, apparatus, and method for depth and color camera image synchronization. Depth and color camera input images are received or otherwise obtained unsynchronized and without associated creation timestamps. An image of one type is compared with an image of a different type to determine a match for synchronization. Matches may be determined according to edge detection or depth coordinate detection. When a match is determined a synchronized pair is formed for processing within an augmented reality output. Optionally the synchronized pair may be transformed to improve the match between the image pair.
-
Citations
30 Claims
-
1. A method for depth and color camera image synchronization, the method comprising:
-
obtaining a plurality of input images comprising a first image type and a second image type different from the first image type, wherein an image type is either a depth camera image type or color camera image type, wherein each image type is unsynchronized with respect to images of other types, and wherein each of the plurality of input images are without identification of an input image'"'"'s actual creation time; selecting, from input images of the first image type, a target image; selecting, from input images of the second image type, a comparison image; determining whether the comparison image is compatible for synchronization with the target image; in response to a determination that the comparison image is compatible for synchronization with the target image, identifying the target image and the comparison image as a synchronized image pair; and processing the synchronized image pair together for use in an augmented reality output. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A device for depth and color camera image synchronization comprising:
-
memory; and a processor coupled to the memory and configured to; obtain, from the memory, a plurality of input images comprising a first image type and a second image type different from the first image type, wherein an image type is either a depth camera image type or color camera image type, wherein each image type is unsynchronized with respect to images of other types, and wherein each of the plurality of input images are without identification of an input image'"'"'s actual creation time; select, from input images of the first image type, a target image; select, from input images of the second image type, a comparison image; determine whether the comparison image is compatible for synchronization with the target image; in response to a determination that the comparison image is compatible for synchronization with the target image, identify the target image and the comparison image as a synchronized image pair; and process the synchronized image pair together for use in an augmented reality output. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A machine readable non-transitory storage medium having stored therein program instructions that are executable by a processor to:
-
obtain a plurality of input images comprising a first image type and a second image type different from the first image type, wherein an image type is either a depth camera image type or color camera image type, wherein each image type is unsynchronized with respect to images of other types, and wherein each of the plurality of input images are without identification of an input image'"'"'s actual creation time; select, from input images of the first image type, a target image; select, from input images of the second image type, a comparison image; determine whether the comparison image is compatible for synchronization with the target image; in response to a determination that the comparison image is compatible for synchronization with the target image, identify the target image and the comparison image as a synchronized image pair; and process the synchronized image pair together for use in an augmented reality output. - View Dependent Claims (18, 19, 20, 21, 22, 23)
-
-
24. An apparatus to synchronize depth and color camera images, the apparatus comprising:
-
means for obtaining a plurality of input images comprising a first image type and a second image type different from the first image type, wherein an image type is either a depth camera image type or color camera image type, wherein each image type is received unsynchronized with respect to images of other types, and wherein each of the plurality of input images are received without identification of an input image'"'"'s actual creation time; means for selecting, from input images of the first image type, a target image; means for selecting, from input images of the second image type, a comparison image; means for determining whether the comparison image is compatible for synchronization with the target image; means for identifying that the target image and the comparison image as a synchronized image pair, in response to a determination that the comparison image is compatible for synchronization with the target image; and means for processing the synchronized image pair together for use in an augmented reality output. - View Dependent Claims (25, 26, 27, 28, 29, 30)
-
Specification