Providing information associated with an identified representation of an object

• US 8,929,591 B2
• Filed: 01/01/2012
• Issued: 01/06/2015
• Est. Priority Date: 03/08/2011
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Calman, Matthew A., Ross, Erik Stephen, Hamilton, Alfred
• Primary Examiner(s): Park, Chan
• Assistant Examiner(s): Kholdebarin, Iman K
• Application Number:
  US13/342,056
• Publication Number:
  US 20120230538A1
• Time in Patent Office: 1,101 Days
• Field of Search: None
• US Class Current: 382/103
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

Methods, apparatus systems and computer program products are described herein that provide for using video or still shot analysis, such as AR or the like, to assist the user of mobile devices with receiving information corresponding to an abstraction or representation of a subject. Some subjects are difficult to capture in a video or still shot. The method and devices described herein capture representations of difficult to capture or unavailable subjects and presents information related to the subject with the representation. In an embodiment, the representation is a screenshot and the information is provided related to the application that is represented by the screenshot. Various other types of representations including depictions, advertisements, portions of, and identifying marks can be identified by the system and method and information presented relating to the corresponding subjects. In some cases, the information is customized with financial information of the user.

Claims

1. A method for presenting information based on a captured representation of a subject, the method comprising:

determining that a mobile phone is capturing a real-time video of a scene, wherein the scene comprises at least one representation of an individual of interest to a user of the mobile phone, wherein the representation is a picture of the individual;

determining positioning information of the mobile phone, wherein the positioning information is associated with the real-time video being captured by the mobile phone;

recognizing, via the mobile phone, the representation of the individual in the real-time video based on an analysis of markers associated with the representation;

identifying, via a computing device processor, the individual using a database comprising a plurality of individuals and associated representations;

confirming the identification of the individual to the desired confidence level;

retrieving information corresponding to previous transfers of money between the user and the individual;

presenting the information using the mobile phone, the information related to the individual presented in conjunction with presentation of the representation; and

superimposing the information over the video being captured by the mobile phone.

2. The method of claim 1, further comprising initiating a transfer of money to the individual via the mobile phone.

3. The method of claim 1, wherein the representation is a depiction of the individual in a medium selected from the group consisting of a photograph, a painting, a poster, and a picture.

4. The method of claim 1, wherein the representation comprises an identifying mark of the individual.

5. An apparatus for presenting information based on a captured representation of a subject, the apparatus comprising:

a computing platform having a processor, a memory in communication with the processor,

logic stored in the memory, executable by the processor and configured to determine that a mobile phone is capturing a real-time video of a scene, wherein the scene comprises at least one representation of an individual of interest to a user of the mobile phone, wherein the representation is a picture of the individual;

positioning logic stored in the memory, executable by the processor and configured to determine positioning information of the mobile phone, wherein the positioning information is associated with the real-time video being captured by the mobile phone,

image capture logic stored in the memory, executable by the processor and configured to capture the video comprising a representation of the individual in the real-time video based on an analysis of markers associated with the representation,

analysis logic stored in the memory, executable by the processor and configured to analyze the representation in the video,

image identification logic stored in the memory, executable by the processor and configured to identify the individual using a database comprising a plurality of individuals and associated representations,

confirmation logic stored in the memory, executable by the processor and configured to confirm the identification of the individual to the desired confidence level;

retrieval logic stored in the memory, executable by the processor and configured to retrieve information corresponding to previous transfers of money between the user and the individual; and

presentation logic stored in the memory, executable by the processor and configured to present the information related to the individual in the video, and superimpose the information over the video being captured by the mobile phone.

6. The apparatus of claim 5, further comprising a network interface device, wherein the network interface device is configured to wirelessly connect to the database comprising the plurality of individuals and associated representations.

7. The apparatus of claim 5, further comprising customization logic stored in the memory, executable by the processor, and configured to customize a presentation for a user.

8. The apparatus of claim 7, further comprising transfer logic stored in the memory, executable by the processor and configured to initiate a transfer of money to the individual via the mobile phone.

9. The apparatus of claim 5, further comprising a display, wherein the information is presented on the display.

10. A computer program product, comprising a non-transitory computer-readable medium comprising computer-executable instructions for presenting information based on a captured representation of a subject, the instructions comprising:

instructions for determining that a mobile phone is capturing a real-time video of a scene, wherein the scene comprises at least one representation of an individual of interest to a user of the mobile phone, wherein the representation is a picture of the individual;

instructions for determining positioning information of the mobile phone, wherein the positioning information is associated with the real-time video being captured by the mobile phone;

instructions for capturing the video comprising a representation of the individual in the real-time video based on an analysis of markers associated with the representation;

instructions for analyzing the representation in the video;

instructions for identifying the individual using a database comprising a plurality of individuals and associated representations;

instructions for confirming the identification of the individual to the desired confidence level;

instructions for retrieving information corresponding to previous transfers of money between the user and the individual;

instructions for presenting the information related to the individual in the video; and

instructions for superimposing the information over the video being captured by the mobile device.

11. The computer program product of claim 10, further comprising instructions for initiating a transfer of money to the individual via the mobile phone.