OVERLAY FOR CAMERA FIELD OF VISION

• US 20170124764A1
• Filed: 11/02/2015
• Published: 05/04/2017
• Est. Priority Date: 11/02/2015
• Status: Active Grant

• Current Assignee: Roblox Corp.
• Original Assignee: International Business Machines Corporation
• Inventors: Akselrod, Ben Z., Di Loreto, Anthony, McDuff, Steve, Robeson, Kyle D.
• Granted Patent: US 9,928,658 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

One or more computer processors generate an augmented reality overlay for camera field of vision. The one or more processors determine a field of view of an imaging device. The one or more processors generate an overlay image that represents the field of view of the imaging device. The one or more processors determine a location of an image display device in respect to the field of view of the imaging device. The one or more processors generate a modified overlay image by modifying one or both of a size and an orientation of the overlay image. The modification is based on the location of the image display device in respect to the field of view of the imaging device. The one or more processors display the modified overlay image by the image display device in real-time.

Claims

1. A method for generating an augmented reality overlay for camera field of vision, the method comprising:

determining, by one or more processors, a field of view of an imaging device;

generating, by the one or more processors, an overlay image that represents the field of view of the imaging device;

determining, by the one or more processors, a location of an image display device in respect to the field of view of the imaging device;

generating, by the one or more processors, a modified overlay image by modification of one or both of a size and an orientation of the overlay image based, at least in part, on the location of the image display device in respect to the field of view of the imaging device; and

displaying, by the one or more processors, in real-time, the modified overlay image using the image display device.

2. The method of claim 1, wherein the image display device is worn by a user such that the vision of that user includes the modified overlay image.

3. The method of claim 1, wherein determining, by one or more processors, a field of view of an imaging device comprises:

determining, by the one or more processors, a location of the imaging device based, at least in part, on a data from at least one of an indoor positioning system, a global positioning system, and one or more orientation sensors, wherein a measure of a depth of field of the field of view is based, at least in part, on the data.

4. The method of claim 1, wherein determining, by one or more processors, a field of view of an imaging device comprises:

identifying, by the one or more processors, a known object included in an image data received from the imaging device; and

determining, by the one or more processors, a location of the imaging device based, at least in part, on a comparison between a known orientation and known size of the known object and an apparent orientation and apparent size of the object as included in the image data.

5. The method of claim 1, wherein the modified overlay image includes at least one of a) three dimensional shape with one or more edges that outline at least a portion of the field of view of the imaging device, b) a first content that is viewable by the imaging device, c) a second content as seen through an obstacle, d) a depth view of the imaging device, and e) a visual identifier that indicates an object that is obstructed from the field of view of the imaging device.

6. The method of claim 1, the method comprising:

determining, by the one or more processors, that a type of criterion has been met that dictate that the overlay image is to be updated; and

updating, by the one or more processors, the overlay image based, at least in part, on the type of criterion.

7. The method of claim 6, wherein the type of criterion includes at least one of a) passage of a predetermined time period, b) a change in one or both of the location of the image display device and a location of the imaging device, c) a change in a content being captured by the imaging device, and d) a change in one or more settings of the imaging device.

8. A computer program product for generating an augmented reality overlay for camera field of vision, the computer program product comprising:

one or more computer-readable storage media and program instructions stored on the one or more computer-readable storage media, the program instructions comprising;

program instructions to determine a field of view of an imaging device;

program instructions to generate an overlay image that represents the field of view of the imaging device;

program instructions to determine a location of an image display device in respect to the field of view of the imaging device;

program instructions to generate a modified overlay image by modification of one or both of a size and an orientation of the overlay image based, at least in part, on the location of the image display device in respect to the field of view of the imaging device; and

program instructions to display in real-time the modified overlay image using the image display device.

9. The computer program product of claim 8, wherein the image display device is worn by a user such that the vision of that user includes the modified overlay image.

10. The computer program product of claim 8, wherein determining, by one or more processors, a field of view of an imaging device comprises:

program instructions to determine a location of the imaging device based, at least in part, on a data from at least one of an indoor positioning system, a global positioning system, and one or more orientation sensors, wherein a measure of a depth of field of the field of view is based, at least in part, on the data.

11. The computer program product of claim 8, wherein determining, by one or more processors, a field of view of an imaging device comprises:

program instructions to identify a known object included in an image data received from the imaging device; and

program instructions to determine a location of the imaging device based, at least in part, on a comparison between a known orientation and known size of the known object and an apparent orientation and apparent size of the object as included in the image data.

12. The computer program product of claim 8, wherein the modified overlay image includes at least one of a) three dimensional shape with one or more edges that outline at least a portion of the field of view of the imaging device, b) a first content that is viewable by the imaging device, c) a second content as seen through an obstacle, d) a depth view of the imaging device, and e) a visual identifier that indicates an object that is obstructed from the field of view of the imaging device.

13. The computer program product of claim 8, the program instructions comprising:

program instructions to determine that a type of criterion has been met that dictates that the overlay image is to be updated; and

program instructions to update the overlay image based, at least in part, on the type of criterion.

14. The computer program product of claim 13, wherein the type of criterion includes at least one of a) passage of a predetermined time period, b) a change in one or both of the location of the image display device and a location of the imaging device, c) a change in a content being captured by the imaging device, and d) a change in one or more settings of the imaging device.

15. A computer system for generating an augmented reality overlay for camera field of vision, the computer system comprising:

one or more computer processors;

one or more computer readable storage medium;

program instructions stored on the computer readable storage medium for execution by at least one of the one or more processors, the program instructions comprising;

program instructions to determine a field of view of an imaging device;

program instructions to generate an overlay image that represents the field of view of the imaging device;

program instructions to determine a location of an image display device in respect to the field of view of the imaging device;

program instructions to generate a modified overlay image by modification of one or both of a size and an orientation of the overlay image based, at least in part, on the location of the image display device in respect to the field of view of the imaging device; and

program instructions to display in real-time the modified overlay image using the image display device.

16. The computer system of claim 15, wherein the image display device is worn by a user such that the vision of that user includes the modified overlay image.

17. The computer system of claim 15, wherein the program instructions to determine a field of view of an imaging device comprises:

program instructions to determine a location of the imaging device based, at least in part, on a data from at least one of an indoor positioning system, a global positioning system, and one or more orientation sensors, wherein a measure of a depth of field of the field of view is based, at least in part, on the data.

18. The computer system of claim 15, wherein the program instructions to determine a field of view of an imaging device comprises:

program instructions to identify a known object included in an image data received from the imaging device; and

program instructions to determine a location of the imaging device based, at least in part, on a comparison between a known orientation and known size of the known object and an apparent orientation and apparent size of the object as included in the image data.

19. The computer system of claim 15, wherein the modified overlay image includes at least one of a) three dimensional shape with one or more edges that outline at least a portion of the field of view of the imaging device, b) a first content that is viewable by the imaging device, c) a second content as seen through an obstacle, d) a depth view of the imaging device, and e) a visual identifier that indicates an object that is obstructed from the field of view of the imaging device.

20. The computer system of claim 15, the program instructions comprising:

program instructions to determine that a type of criterion has been met that dictates that the overlay image is to be updated; and

program instructions to update the overlay image based, at least in part, on the type of criterion.