Multi-spectrum segmentation for computer vision
First Claim
1. A device comprising:
- a first optical sensor configured to operate within a first spectrum range and to generate first image data corresponding to a first image captured by the first optical sensor, the first optical sensor comprising a depth sensor configured to generate depth image data for the first image;
a second optical sensor configured to operate within a second spectrum range different from the first spectrum range and to generate second image data corresponding to a second image captured by the second optical sensor;
one or more hardware processor configured to perform operations comprising;
identifying, from the first image data, a first region in the first image, the first region of the first image comprising corresponding depth image data that exceed a depth threshold,mapping a first portion of the first image data corresponding to the first region in the first image to a second portion of the second image data corresponding to a second region in the second image,providing the second portion of the second image data to a server configured to generate augmented reality content based on the second portion of the second image data, andreceiving the augmented reality content from the server; and
a display configured to display the augmented reality content.
12 Assignments
0 Petitions
Accused Products
Abstract
A device for multi-spectrum segmentation for computer vision is described. A first optical sensor operates within a first spectrum range and generates first image data corresponding to a first image captured by the first optical sensor. A second optical sensor operates within a second spectrum range different from the first spectrum range and generates second image data corresponding to a second image captured by the second optical sensor. The device identifies a first region in the first image, maps a first portion of the first image to a second portion of the second image data, provides the second portion of the second image data to a server that generates augmented reality content based on the second portion of the second image data. The device displays the augmented reality content.
-
Citations
18 Claims
-
1. A device comprising:
-
a first optical sensor configured to operate within a first spectrum range and to generate first image data corresponding to a first image captured by the first optical sensor, the first optical sensor comprising a depth sensor configured to generate depth image data for the first image; a second optical sensor configured to operate within a second spectrum range different from the first spectrum range and to generate second image data corresponding to a second image captured by the second optical sensor; one or more hardware processor configured to perform operations comprising; identifying, from the first image data, a first region in the first image, the first region of the first image comprising corresponding depth image data that exceed a depth threshold, mapping a first portion of the first image data corresponding to the first region in the first image to a second portion of the second image data corresponding to a second region in the second image, providing the second portion of the second image data to a server configured to generate augmented reality content based on the second portion of the second image data, and receiving the augmented reality content from the server; and a display configured to display the augmented reality content. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method comprising:
-
accessing, at a device, first image data corresponding to a first image captured by a first optical sensor of the device, the first optical sensor configured to operate within a first spectrum range, the first optical sensor comprising a depth sensor configured to generate depth image data for the first image; accessing at the device, second image data corresponding to a second image captured by a second optical sensor of the device, the second optical sensor configured to operate within a second spectrum range different from the first spectrum range; identifying, from the first image data, a first region in the first image, the first region of the first image comprising corresponding depth image data that exceed a depth threshold; mapping a first portion of the first image data corresponding to the first region in the first image to a second portion of the second image data corresponding to a second region in the second image; providing the second portion of the second image data to a server configured to generate augmented reality content based on the second portion of the second image data; receiving the augmented reality content from the server; and displaying the augmented reality content in a display of the device. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
-
accessing at a device, first image data corresponding to a first image captured by a first optical sensor of the device, the first optical sensor configured to operate within a first spectrum range, the first optical sensor comprising a depth sensor configured to generate depth image data for the first image; accessing at the device, second image data corresponding to a second image captured by a second optical sensor of the device, the second optical sensor configured to operate within a second spectrum range different from the first spectrum range; identifying, from the first image data, a first region in the first image, the first region of the first image comprising corresponding depth image data that exceed a depth threshold; mapping a first portion of the first image data corresponding to the first region in the first image to a second portion of the second image data corresponding to a second region in the second image; providing the second portion of the second image data to a server configured to generate augmented reality content based on the second portion of the second image data; receiving the augmented reality content from the server; and displaying the augmented reality content in a display of the device.
-
Specification