Mobile Device with Image Recognition Processing Capability

• US 20090237546A1
• Filed: 03/24/2008
• Published: 09/24/2009
• Est. Priority Date: 03/24/2008
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications AB (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications AB (Sony Group Corp.)
• Inventors: Wakefield, Ivan Nelson, Bloebaum, L. Scott, Rutledge, Melissa
• Application Number:
  US12/053,812
• Publication Number:
  US 20090237546A1
• Time in Patent Office: Days
• US Class Current: 348/333.10
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06Q 10/20 Administration of product repair or maintenance
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: H04N 1/00323 with a measuring, monitoring or signaling apparatus, e.g. for transmitting measured information to a central location

Abstract

An image of an object is captured using a portable electronic device. The image is displayed on a display screen of the portable electronic device. Image recognition is performed on the image to identify the object, a task associated with the identified object is identified, and information about the task is displayed on the display screen of the portable electronic device along with the image.

Claims

1. A method, comprising:

capturing an image of an object using a portable electronic device;

displaying the image on a display screen of the portable electronic device;

performing image recognition to identify the object;

identifying information associated with the identified object; and

displaying the information on the display screen of the portable electronic device.

2. The method of claim 1, wherein displaying the information comprises displaying a list of supplies used in performing a task associated with the identified object.

3. The method of claim 1, wherein capturing the image comprises capturing the image using a camera in the portable electronic device;

and

wherein identifying the object comprises transmitting the image from the portable electronic device to an application server over a wireless communication interface and receiving identification information from the application server over the wireless communication interface.

4. The method of claim 3, wherein identifying the object comprises:

generating a list of postulated object identifications in response to the transmitted image;

transmitting the list of postulated object identifications to the portable electronic device; and

presenting the list of postulated object identifications to a user of the portable electronic device so that the user can select one of the postulated object identifications from the list.

5. The method of claim 4, wherein identifying the object comprises:

extracting features of the object from the image; and

comparing extracted features to features of objects that are stored in an object identification database.

6. The method of claim 1, wherein the captured image comprises a static image, the method further comprising:

scrolling over the static image until a part of the object is displayed;

wherein performing image recognition to identify the object comprises performing image recognition to identify the part of the object.

7. The method of claim 6, further comprising:

identifying different parts of the object while scrolling over the static image; and

displaying information about the respective different parts as they are identified.

8. The method of claim 2, further comprising:

determining if a supply on the list of supplies is in an inventory; and

flagging the supply on the displayed list of supplies as being available in inventory.

9. The method of claim 2, further comprising:

determining if a supply on the list of supplies has been recently purchased; and

flagging the supply on the displayed list of supplies as being recently purchased.

10. The method of claim 9, wherein determining if the supply has been recently purchased comprises accessing a database of recent purchases.

11. The method of claim 1, further comprising:

identifying candidate tasks associated with the identified object;

displaying a list of the candidate tasks; and

selecting a task from among the list of candidate tasks.

12. The method of claim 11, further comprising:

generating a list of supplies used in performing the selected task in response to the selection of a task from among the list of candidate tasks.

13. A portable electronic device, comprising:

a processor;

a camera coupled to the processor and configured to capture an image;

a display screen coupled to the processor and configured to display the image; and

a module configured to identify the object from the image, to identify information associated with the identified object, and to display the information on the display screen of the portable electronic device.

14. The portable electronic device of claim 13, wherein the module is further configured to superimpose the information onto the display screen over the image.

15. The portable electronic device of claim 13, wherein the module is configured to transmit the image to an application server over a wireless communication interface and to receive identification information from the application server over the wireless communication interface.

16. The portable electronic device of claim 13, wherein the module is configured to generate a list of postulated object identifications in response to the image, and to present the list of postulated object identifications to a user of the portable electronic device so that the user can select one of the postulated object identifications from the list.

17. The portable electronic device of claim 16, wherein the module is configured to extract features of the object from the image, and to compare the extracted features to features of objects that are stored in an object identification database.

18. A computer program product, comprising:

a computer readable storage medium having computer readable program code embodied in the medium, the computer readable program code comprising;

computer readable program code configured to capture an image of an object using a portable electronic device;

computer readable program code configured to display the image on a display screen of the portable electronic device;

computer readable program code configured to perform image recognition to identify the object;

computer readable program code configured to identify a task associated with the identified object; and

computer readable program code configured to display information about the task on the display screen of the portable electronic device.

19. The computer program product of claim 18, further comprising:

computer readable program code configured to capture the image using a camera in the portable electronic device; and

computer readable program code configured to transmit the image from the portable electronic device to an application server over a wireless communication interface and to receive identification information from the application server over the wireless communication interface.

20. The computer program product of claim 18, further comprising:

computer readable program code configured to extract features of the object from the image; and

computer readable program code configured to compare extracted features to features of objects that are stored in an object identification database.