AUGMENTED REALITY DEVICE DISPLAY OF IMAGE RECOGNITION ANALYSIS MATCHES

• US 20160203641A1
• Filed: 01/14/2015
• Published: 07/14/2016
• Est. Priority Date: 01/14/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bostick, James E., Ganci, John M. Jr., Rakshit, Sarbajit K., Trim, Craig M.
• Granted Patent: US 9,646,419 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Aspects provide for notifications of image recognition analysis matches to streamed image data on augmented reality device displays. Data identifies one or more visual appearance attributes of a target object that are discernible within image data acquired by a camera. Image data captured by a camera is analyzed to determine an occurrence of the visual appearance attribute(s) within a stream of images of captured image data. In response to the analyzing determining an occurrence of the visual appearance attribute(s) within the stream of captured images, the method drives a display screen of the augmented reality device to distinguish a possible location of the target object within surroundings of a user of the augmented reality display device that are displayed to the user by the display screen.

Claims

1. A method for presenting notifications of image recognition analysis matches to streamed image data on an augmented reality device display, the method comprising:

receiving, at an augmented reality device, data that identifies at least one visual appearance attribute of a target object, wherein the at least one visual appearance attribute is discernible within image data acquired by a camera of the augmented reality display device;

analyzing image data captured by the camera to determine an occurrence of the at least one visual appearance attribute of the target object within a stream of images of the captured image data, wherein the analyzing the stream of images is performed by an image recognition application executing on a processor of the augmented reality display device that detects the occurrence of the at least one visual appearance attribute within the captured image data stream of images; and

in response to the analyzing of the image data determining an occurrence of the at least one visual appearance attribute of the target object within the stream of captured images, driving a display screen of the augmented reality device to distinguish a possible location of the target object within surroundings of a user of the augmented reality display device that are displayed to the user by the display screen.

2. The method of claim 1, wherein the step of receiving the data that identifies the at least one visual appearance attribute of the target object comprises:

continually receiving a stream of data; and

updating the at least one visual appearance attribute with a new attribute from the stream of data in response to a data broadcast of the new attribute with an alert generated by another augmented reality device, wherein the alert is generated by the another augmented reality device in response to a determination that the at least one visual appearance attribute is discernible within image data acquired by a camera of the another augmented reality device.

3. The method of claim 1, wherein the display screen elements is one of a spectacle lens worn by the user, and a window of a vehicle occupied by the user;

and

wherein the display screen is semi-transparent and deployed for the user to view the surroundings of the user through it and to distinguish the possible location of the target object within the surroundings of the user by highlighting an object viewed through the semi-transparent display screen.

4. The method of claim 1, further comprising:

determining a location of the target object as a function of a viewing angle of the camera and a current global positioning coordinate of the device.

5. The method of claim 1, further comprising:

generating an alert in response to the analyzing the image data determining the occurrence of the at least one visual appearance attribute of the target object within the stream of captured images; and

communicating the alert to at least one of a centralized database and another augmented reality device.

6. The method of claim 5, further comprising:

generating the alert to comprise a time of acquisition of the stream of captured images, and a geographic location of the augmented reality device at the time of acquisition of the stream of captured images.

7. The method of claim 6, further comprising:

generating a confidence rating of the alert as a function of at least one of a number of at least one visual appearance attributes of the target object determined to occur within the stream of captured images, and an importance of the at least one visual attribute of the target object determined to occur within the stream of captured images.

8. The method of claim 7, further comprising:

generating the confidence rating of the alert to have a high confidence value as a function of determining that two or more of the at least one visual appearance attribute of the target object occur within the stream of captured images, or that one of the at least one visual attributes of the target object determined to occur within the stream of captured images has a high importance.

9. The method of claim 6, further comprising:

generating the confidence rating of the alert to have a low confidence value as a function of determining that the target object is unlikely to be located at a present location of the augmented reality display device in view of a distance to a location of another augmented reality display device at a time of a generation of another alert by the another augmented reality display device generated in response to an occurrence of the at least one visual appearance attribute of the target object within a stream of images of image data captured by a camera of the another augmented reality display device.

10. The method of claim 1, further comprising:

integrating computer readable program code into a computer readable storage medium; and

wherein a processor that is in circuit communication with a computer readable memory and the computer readable storage medium executes instructions of the program code integrated on the computer readable storage medium via the computer readable memory and thereby performs the steps of receiving the data that identifies the at least one visual appearance attribute of the target object, the analyzing the image data captured by the camera to determine the occurrence of the at least one visual appearance attribute of the target object within the stream of images of the captured image data; and

driving the display screen of the augmented reality device to distinguish the possible location of the target object within the surroundings of the user of the augmented reality display device displayed to the user by the display screen in response to the analyzing the image data determining the occurrence of the at least one visual appearance attribute of the target object within the stream of captured images.

11. A system, comprising:

a processor;

a computer readable memory in circuit communication with the processor;

a computer readable storage medium in circuit communication with the processor;

a camera in circuit communication with the processor; and

a display screen in circuit communication with the processor;

wherein the processor executes program instructions stored on the computer readable storage medium via the computer readable memory and thereby;

receives data that identifies at least one visual appearance attribute of a target object, wherein the at least one visual appearance attribute is discernible within image data acquired by the camera;

analyzes, via executing an image recognition application, image data captured by the camera to determine an occurrence of the at least one visual appearance attribute of the target object within a stream of images of the captured image data, by detecting the occurrence of the at least one visual appearance attribute within the captured image data stream of images; and

in response determining an occurrence of the at least one visual appearance attribute of the target object within the stream of captured images, drives the display screen to distinguish a possible location of the target object within surroundings of a user of the system that are displayed to the user by the display screen.

12. The system of claim 11, wherein the display screen elements is one of a spectacle lens worn by the user, and a window of a vehicle occupied by the user;

and

wherein the display screen is semi-transparent and deployed for the user to view the surroundings of the user through it and to distinguish the possible location of the target object within the surroundings of the user by highlighting an object viewed through the semi-transparent display screen.

13. The system of claim 12, wherein the processor executes the program instructions stored on the computer-readable storage medium via the computer readable memory and thereby further:

in response to the analysis of the image data determining the occurrence of the at least one visual appearance attribute of the target object within the stream of captured images, generates an alert to comprise a time of acquisition of the stream of captured images and a geographic location of the augmented reality device at the time of acquisition of the stream of captured images; and

communicates the alert to at least one of a centralized database and another augmented reality device.

14. The system of claim 13, wherein the processor executes the program instructions stored on the computer-readable storage medium via the computer readable memory and thereby further:

generates a confidence rating of the alert as a function of at least one of a number of at least one visual appearance attributes of the target object determined to occur within the stream of captured images, and an importance of the at least one visual attribute of the target object determined to occur within the stream of captured images.

15. The system of claim 14, wherein the processor executes the program instructions stored on the computer-readable storage medium via the computer readable memory and thereby further:

generates the confidence rating of the alert to have a high confidence value as a function of determining that two or more of the at least one visual appearance attribute of the target object occur within the stream of captured images, or that one of the at least one visual attributes of the target object determined to occur within the stream of captured images has a high importance.

16. The system of claim 15, wherein the processor executes the program instructions stored on the computer-readable storage medium via the computer readable memory and thereby further:

generates the confidence rating of the alert to have a low confidence value as a function of determining that the target object is unlikely to be located at a present location of the augmented reality display device in view of a distance to a location of another augmented reality display device at a time of a generation of another alert by the another augmented reality display device generated in response to an occurrence of the at least one visual appearance attribute of the target object within a stream of images of image data captured by a camera of the another augmented reality display device.

17. A computer program product for presenting notifications of image recognition analysis matches to streamed image data on an augmented reality device display, the computer program product comprising:

a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising instructions for execution by a processor that cause the processor to;

receive data that identifies at least one visual appearance attribute of a target object, wherein the at least one visual appearance attribute is discernible within image data acquired by a camera in circuit communication with the processor;

analyze, via executing an image recognition application, image data captured by the camera to determine an occurrence of the at least one visual appearance attribute of the target object within a stream of images of the captured image data, by detecting the occurrence of the at least one visual appearance attribute within the captured image data stream of images; and

in response to determining an occurrence of the at least one visual appearance attribute of the target object within the stream of captured images, drive a display screen in circuit communication with the processor to distinguish a possible location of the target object within surroundings of a user of the system that are displayed to the user by the display screen.

18. The computer program product of claim 17, wherein the display screen elements is one of a spectacle lens worn by the user, and a window of a vehicle occupied by the user;

wherein the display screen is semi-transparent and deployed for the user to view the surroundings of the user through it and to distinguish the possible location of the target object within the surroundings of the user by highlighting an object viewed through the semi-transparent display screen; and

wherein the computer readable program code instructions for execution by the processor further cause the processor to;

in response to the analysis of the image data determining the occurrence of the at least one visual appearance attribute of the target object within the stream of captured images, generate an alert to comprise a time of acquisition of the stream of captured images and a geographic location of the augmented reality device at the time of acquisition of the stream of captured images; and

communicate the alert to at least one of a centralized database and another augmented reality device.

19. The computer program product of claim 18, wherein the computer readable program code instructions for execution by the processor further cause the processor to

generate a confidence rating of the alert as a function of at least one of a number of at least one visual appearance attributes of the target object determined to occur within the stream of captured images, and an importance of the at least one visual attribute of the target object determined to occur within the stream of captured images.

20. The computer program product of claim 19, wherein the computer readable program code instructions for execution by the processor further cause the processor to:

generate the confidence rating of the alert to have a high confidence value as a function of determining that two or more of the at least one visual appearance attribute of the target object occur within the stream of captured images, or that one of the at least one visual attributes of the target object determined to occur within the stream of captured images has a high importance.