Capturing contextual information on a device

• US 9,747,528 B1
• Filed: 10/26/2016
• Issued: 08/29/2017
• Est. Priority Date: 10/26/2016
• Status: Active Grant

• Current Assignee: HCL Technologies Limited
• Original Assignee: International Business Machines Corporation
• Inventors: Duschl, Heather L., Markello, Alexandra D., Price, Dana L.
• Primary Examiner(s): Kassa, Yosef
• Application Number:
  US15/334,598
• Time in Patent Office: 307 Days
• Field of Search: 382209, 382224, 382229, 382278, 382282, 382307, 709217, 709218, 709219
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06V 10/23 based on positionally close patterns or neighbourhood relationships

Abstract

An approach is disclosed that captures, at a digital camera of a first information handling system, a digital image of a display of a second information handling system. The approach analyzes the captured digital image with the analysis resulting in an identification of a network location that corresponds to the captured digital image. Data from the identified network location is retrieved via a network connection from the first information handling system and this data is displayed on a display that is accessible by the first information handling system.

Claims

1. A method comprising:

capturing, at a digital camera of a first information handling system, a digital image of a display of a second information handling system;

analyzing the captured digital image, the analysis resulting in an identification of a network location corresponding to the captured digital image, wherein the analyzing further comprises;

identifying one or more portions of the digital image;

comparing the identified portions of the digital image with a plurality of stored network location contextual image data; and

identifying one or more possible network locations based on the comparison;

retrieving, at the first information handling system, data from the identified network location via a network connection; and

displaying the data from the identified network location at a first display accessible by the first information handling system.

2. The method of claim 1 further comprising:

detecting a software application used to display the digital image on the display of the second information handling system, the detecting further comprising;

identifying one or more portions of the digital image;

comparing the identified portions of the digital image with a plurality of stored application contextual image data; and

identifying the software application based on the comparison.

3. The method of claim 2 further comprising:

executing the identified software application at the first information handling system; and

loading the data from the identified network location into the software application executing at the first information handling system, wherein the loading results in the displaying of a user interface of the software application and the data at the first display.

4. The method of claim 1 wherein the analyzing further comprises:

identifying one or more portions of the digital image that include image of text;

extracting the textual images from the digital image;

converting the extracted textual images to a plurality of text characters using a character recognition process;

comparing the text characters to a plurality of sets of text characters, wherein each of the sets of text characters corresponds to a network location from a plurality of stored network locations; and

identifying the network locations based on the comparison.

5. The method of claim 1 further comprising:

detecting a software application used to display the digital image on the display of the second information handling system, the detecting further comprising;

identifying one or more portions of the digital image that include image of text;

extracting the textual images from the digital image;

converting the extracted textual images to a plurality of text characters using a character recognition process;

comparing the identified portions of the digital image with a plurality of stored application sets of text data; and

identifying the software application based on the comparison.

6. The method of claim 5 further comprising:

executing the identified software application at the first information handling system; and

loading the data from the identified network location into the software application executing at the first information handling system, wherein the loading results in the displaying of a user interface of the software application and the data at the first display.

7. An information handling system comprising:

one or more processors;

a memory coupled to at least one of the processors; and

a set of instructions stored in the memory and executed by at least one of the processors to perform actions comprising;

capturing, at a digital camera of a first information handling system, a digital image of a display of a second information handling system;

analyzing the captured digital image, the analysis resulting in an identification of a network location corresponding to the captured digital image analyzing the captured digital image, the analysis resulting in an identification of a network location corresponding to the captured digital image, wherein the analyzing further comprises;

identifying one or more portions of the digital image;

comparing the identified portions of the digital image with a plurality of stored network location contextual image data; and

identifying one or more possible network locations based on the comparison;

retrieving, at the first information handling system, data from the identified network location via a network connection; and

displaying the data from the identified network location at a first display accessible by the first information handling system.

8. The information handling system of claim 7 wherein the actions further comprise:

detecting a software application used to display the digital image on the display of the second information handling system, the detecting wherein the actions further comprise;

identifying one or more portions of the digital image;

comparing the identified portions of the digital image with a plurality of stored application contextual image data; and

identifying the software application based on the comparison.

9. The information handling system of claim 8 wherein the actions further comprise:

executing the identified software application at the first information handling system; and

loading the data from the identified network location into the software application executing at the first information handling system, wherein the loading results in the displaying of a user interface of the software application and the data at the first display.

10. The information handling system of claim 7 wherein the analyzing further comprises:

identifying one or more portions of the digital image that include image of text;

extracting the textual images from the digital image;

converting the extracted textual images to a plurality of text characters using a character recognition process;

comparing the text characters to a plurality of sets of text characters, wherein each of the sets of text characters corresponds to a network location from a plurality of stored network locations; and

identifying the network locations based on the comparison.

11. The information handling system of claim 7 wherein the actions further comprise:

detecting a software application used to display the digital image on the display of the second information handling system, the detecting further comprising actions of;

identifying one or more portions of the digital image that include image of text;

extracting the textual images from the digital image;

converting the extracted textual images to a plurality of text characters using a character recognition process;

comparing the identified portions of the digital image with a plurality of stored application sets of text data; and

identifying the software application based on the comparison.

12. The information handling system of claim 11 wherein the actions further comprise:

executing the identified software application at the first information handling system; and

loading the data from the identified network location into the software application executing at the first information handling system, wherein the loading results in the displaying of a user interface of the software application and the data at the first display.

13. A computer program product comprising:

a computer readable storage medium comprising a set of computer instructions, the computer instructions effective to;

capturing, at a digital camera of a first information handling system, a digital image of a display of a second information handling system;

analyzing the captured digital image, the analysis resulting in an identification of a network location corresponding to the captured digital image analyzing the captured digital image, the analysis resulting in an identification of a network location corresponding to the captured digital image, wherein the analyzing further comprises;

identifying one or more portions of the digital image;

comparing the identified portions of the digital image with a plurality of stored network location contextual image data; and

identifying one or more possible network locations based on the comparison;

retrieving, at the first information handling system, data from the identified network location via a network connection; and

displaying the data from the identified network location at a first display accessible by the first information handling system.

14. The computer program product of claim 13 wherein the instructions are further effective to:

detecting a software application used to display the digital image on the display of the second information handling system, the detecting wherein the instructions are further effective to;

identifying one or more portions of the digital image;

comparing the identified portions of the digital image with a plurality of stored application contextual image data; and

identifying the software application based on the comparison.

15. The computer program product of claim 14 wherein the instructions are further effective to:

executing the identified software application at the first information handling system; and

loading the data from the identified network location into the software application executing at the first information handling system, wherein the loading results in the displaying of a user interface of the software application and the data at the first display.

16. The computer program product of claim 13 wherein the analyzing further comprises:

identifying one or more portions of the digital image that include image of text;

extracting the textual images from the digital image;

converting the extracted textual images to a plurality of text characters using a character recognition process;

comparing the text characters to a plurality of sets of text characters, wherein each of the sets of text characters corresponds to a network location from a plurality of stored network locations; and

identifying the network locations based on the comparison.

17. The computer program product of claim 13 wherein the instructions are further effective to:

detecting a software application used to display the digital image on the display of the second information handling system, the detecting further comprising;

identifying one or more portions of the digital image that include image of text;

extracting the textual images from the digital image;

converting the extracted textual images to a plurality of text characters using a character recognition process;

comparing the identified portions of the digital image with a plurality of stored application sets of text data; and

identifying the software application based on the comparison.