Providing information regarding medical conditions

• US 8,582,850 B2
• Filed: 01/01/2012
• Issued: 11/12/2013
• Est. Priority Date: 03/08/2011
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Calman, Matthew A., Ross, Erik Stephen
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US13/342,060
• Publication Number:
  US 20120230557A1
• Time in Patent Office: 681 Days
• Field of Search: 382/100, 382/103, 382/113, 382128-134, 382/155, 382/162, 382/168, 382/173, 382/181, 382/203, 382/206, 382/209, 382/224, 382/232, 382/254, 382/274, 382/276, 382/291, 382/305, 455/90.1, 455/555, 707/769, 707/10, 705/44
• US Class Current: 382/128
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

Systems, methods, and computer program products are provided for using real-time video analysis and AR or the like to assist the user of mobile devices with commerce activities. Through the use of real-time vision object recognition medical conditions can be recognized in the real-time video stream and can be matched to medical condition related information regarding the medical condition and can also be matched to one or more targeted offers for products related to the medical condition. The medical condition related information may be presenting to the user of the mobile device in conjunction with display of the associated medical condition in a live video stream. Further, in some embodiments, a product can be recognized as products related to a previously recognized medical condition and indicators associated with the recognized products can be presented with the real-time video stream.

Claims

1. A method for providing medical condition related information, the method comprising:

identifying, via a computing device processor, which objects in an image captured on a mobile communication device correspond to a medical condition based at least in part on global positioning system information associated with the mobile communication device or other information indicating a location of the mobile communication device;

determining, via a computing device processor, which of one or more medical conditions identified in the image video stream have associated medical condition related information; and

presenting, via a display of the image on the mobile communication device, one or more medical condition related information indicators, each medical condition related information indicator presented proximate a location of the one or more medical conditions determined to have associated medical condition related information.

2. The method of claim 1, wherein identifying a medical condition comprises identifying one or more images in a video stream captured on a mobile communication device that correspond to one or more medical conditions.

3. The method of claim 1, wherein identifying a medical condition comprises identifying one or more objects in a still image captured on a mobile communication device that corresponds to one or more medical conditions.

4. The method of claim 1, wherein the medical condition related information comprises information related to the medical condition comprising information regarding proper treatment of the medical condition.

5. The method of claim 1, wherein determining which of the identified medical conditions have associated medical condition related information comprises comparing the identified medical conditions to a database listing of medical conditions currently associated with medical condition related information.

6. An apparatus for providing medical condition related information, the apparatus comprising:

a computing platform having a processor, a memory in communication with the processor, and

image capture logic stored in the memory, executable by the processor and configured to capture an image, and medical condition identification logic stored in the memory, executable by the processor and configured to identify which objects in the image captured by a mobile communication device correspond to a medical condition based at least in part on global positioning system information associated with the mobile communication device or other information indicating a location of the mobile communication device, and

medical condition related information logic stored in the memory, executable by the processor and configured to determine whether the identified medical condition has associated medical condition related information; and

medical condition related information presentation logic stored in the memory, executable by the processor and configured to present, on a display of the mobile communication device, one or more medical condition related information indicators, each medical condition related information indicator presented proximate a location of the medical condition determined to have associated medical condition related information.

7. The apparatus of claim 6, wherein the medical condition identification logic is configured to identify one or more images in a video stream captured on a mobile communication device that correspond to one or more medical conditions.

8. The apparatus of claim 6, wherein the medical condition identification logic is configured to identify one or more objects in a still image captured on a mobile communication device that corresponds to one or more medical conditions.

9. The apparatus of claim 6, wherein the medical condition related information comprises information related to the medical condition comprising information regarding proper treatment of the medical condition.

10. The apparatus of claim 6, wherein the medical condition related information logic is configured to determine which of the identified medical conditions have associated medical condition related information comprises comparing the identified medical conditions to a database listing of medical conditions currently associated with medical condition related information.

11. A computer program product comprising a non-transitory computer-readable medium comprising computer-executable instructions for providing health related information, the instructions comprising:

instructions for identifying which objects in an image captured on a mobile communication device correspond to a medical condition based at least in part on global positioning system information associated with the mobile communication device or other information indicating a location of the mobile communication device;

instructions for determining which of one or more medical conditions identified in the image have associated medical condition related information; and

instructions for presenting one or more medical conditions related information indicators with an image displayed on the mobile communication device, each medical condition related information indicator presented proximate a location of the one or more determined medical conditions.

12. A method for providing medical condition related information, the method comprising:

identifying, via a server in communication with a mobile communication device, which objects in an image captured on a mobile communication device correspond to a medical condition based at least in part on global positioning system information associated with the mobile communication device or other information indicating a location of the mobile communication device;

determining, via the server, which of one or more medical conditions identified in the image have associated medical condition related information; and

communicating instructions to the mobile communication device, via the server, for presenting a display of the image on the mobile communication device, one or more medical condition related information indicators, each medical condition related information indicator presented proximate a location of the one or more medical conditions determined to have associated medical condition related information.

13. The method of claim 12, wherein identifying a medical condition comprises identifying one or more images in a video stream captured on a mobile communication device that correspond to one or more medical conditions.

14. The method of claim 12, wherein identifying a medical condition comprises identifying one or more objects in a still image captured on a mobile communication device that corresponds to one or more medical conditions.

15. The method of claim 12, wherein the medical condition related information comprises information related to the medical condition comprising information regarding proper treatment of the medical condition.

16. The method of claim 12, wherein determining which of the identified medical conditions have associated medical condition related information comprises comparing the identified medical conditions to a database listing of medical conditions currently associated with medical condition related information.

17. An apparatus for providing medical condition related information, the apparatus comprising:

a server having a processor, a memory in communication with the processor, and communication logic stored in the memory, executable by the processor and configured to receive data from a mobile communication device, the data corresponding to one or more objects in an image captured by the mobile communication device;

medical condition identification logic stored in the memory, executable by the processor and configured to identify which objects in the image captured by the mobile communication device correspond to a medical condition based at least in part on global positioning system information associated with the mobile communication device or other information indicating a location of the mobile communication device;

medical condition related information logic stored in the memory, executable by the processor and configured to determine whether the identified medical condition has associated medical condition related information; and

medical condition related information presentation logic stored in the memory, executable by the processor and configured to communicate instructions for presenting, on a display of the mobile communication device, one or more medical condition related information indicators, each medical condition related information indicator presented proximate a location of the medical condition determined to have associated medical condition related information.

18. The apparatus of claim 17, wherein the medical condition identification logic is configured to identify one or more images in a video stream captured on a mobile communication device that correspond to one or more medical conditions.

19. The apparatus of claim 17, wherein the medical condition identification logic is configured to identify one or more objects in a still image captured on a mobile communication device that corresponds to one or more medical conditions.

20. The apparatus of claim 17, wherein the medical condition related information comprises information related to the medical condition comprising information regarding proper treatment of the medical condition.

21. The apparatus of claim 17, wherein the medical condition related information logic is configured to compare the identified medical conditions to a database listing of medical conditions currently associated with medical condition related information.

22. A computer program product comprising a non-transitory computer-readable medium comprising computer-executable instructions for execution on a server in communication with a mobile communication device, the instructions for providing medical condition related information, the instructions comprising:

instructions for identifying which objects in an image captured on a mobile communication device correspond to a medical condition based at least in part on global positioning system information associated with the mobile communication device or other information indicating a location of the mobile communication device;

instructions for determining which of one or more medical conditions identified in the image have associated medical condition related information; and

instructions for communicating instructions to the mobile communication device for presenting one or more medical condition related information indicators with the image displayed on the mobile communication device, each medical condition related information indicator presented proximate a location of the one or more determined medical conditions.

23. A method for providing medical condition information, the method comprising:

identifying, via a computing device processor, which objects in an image captured on a mobile communication device correspond to a product based at least in part on global positioning system information associated with the mobile communication device or other information indicating a location of the mobile communication device;

determining, via a computing device processor, which of one or more products identified in the image are associated with treatment of a previously identified medical condition; and

presenting, via a display of the live video stream on the mobile communication device, one or more medical condition indicators, each medical condition indicator presented proximate a location of the one or more products determined to be associated with treatment of the previously identified medical condition.

25. The method of claim 23, wherein determining which of the identified products have associated medical condition related information comprises comparing the identified products to a database listing of products currently associated with medical condition related information.

26. The method claim 23, further comprising:

storing information related to at least one medical or health need or want of a social network member of a user of the mobile communication device;

determining whether any of the identified products meet the health need or want of the social network member; and

presenting at least one health related information indicator indicating that at least one identified product meets the health need or want of the social network member.

27. The method of claim 23, further comprising:

storing information related to at least one medical or health characteristic of a user of the mobile communication device;

determining whether any of the identified products effect the health characteristic of the user; and

presenting at least one health related information indicator indicating that at least one identified product effects the health characteristic of the user.

24. The method of 23, wherein the medical condition related information comprises at least one of nutrition information, caloric information, medical indication information, proper medicinal treatment information, or financial impact information.

28. An apparatus for providing medical condition information, the apparatus comprising:

a computing platform having a processor, a memory in communication with the processor, and

image capture logic stored in the memory, executable by the processor and configured to capture an image, and

product identification logic stored in the memory, executable by the processor and configured to identify which objects in the image captured by a mobile communication device correspond to a product based at least in part on global positioning system information associated with the mobile communication device or other information indicating a location of the mobile communication device, and

medical condition related information logic stored in the memory, executable by the processor and configured to determine whether the identified product is associated with treatment of a previously identified medical condition; and

medical condition related information presentation logic stored in the memory, executable by the processor and configured to present, on a display of the mobile communication device, one or more medical condition related information indicators, each medical condition related information indicator presented proximate a location of the product determined to be associated with treatment of the previously identified medical condition.