Product identification using mobile device

• US 8,605,189 B2
• Filed: 05/01/2012
• Issued: 12/10/2013
• Est. Priority Date: 05/01/2012
• Status: Expired due to Fees

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Fan, Zhigang, Zhao, Yonghui, Wang, Shen-ge, Ding, Hengzhou
• Primary Examiner(s): CHEN, CHIA WEI A
• Application Number:
  US13/461,014
• Publication Number:
  US 20130293734A1
• Time in Patent Office: 588 Days
• Field of Search: 348/135, 348/222.1, 34833301-33313, 382/181, 382209-223, 382/305, 382/306, 382100-154
• US Class Current: 348/333.02
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

A method and apparatus for obtaining an image and providing one or more document files to a user. The method may include capturing an image of a target object using an imaging device of an electronic device, analyzing the image to identify a plurality of features and feature locations on the target object with a processor using an image recognition application, accessing a model database to identify an appliance model having features and feature locations that match the identified features and feature locations from the image, retrieving one or more document files that correspond to the identified model from a file database, and providing the one or more document files to a user.

Claims

1. A method, comprising:

capturing, by an imaging device of an electronic device, an image of a target object;

analyzing, by a processor using an image recognition application, the image to identify a plurality of features and feature locations on the target object;

accessing, by the processor, a model database to identify one or more appliance models, each having features and feature locations that match the identified features and feature locations from the image;

in response to identifying only one appliance model;

retrieving, by the processor from a file database, one or more document files that correspond to the identified model, and

providing the one or more document files to a user; and

in response to identifying more than one appliance model;

identifying, by the processor, a potential distinguishing feature,

displaying, by a display of the imaging device, a bounded area that corresponds to a location of the potential distinguishing feature,

capturing, by the imaging device, a second image of the target object,

determining, by the processor, whether a portion of the second image that corresponds to the bounded area comprises the potential distinguishing feature, and

in response to determining that the bounded area comprises the potential distinguishing feature;

retrieving, by the processor from the file database, one or more document files that correspond to the identified model, and

providing the one or more document files to the user.

2. The method of claim 1, wherein the one or more document files comprises at least one of the following:

a brochure file, a user manual file, an instruction manual file, and a specification sheet file.

3. The method of claim 1, further comprising:

before the capturing of the image, directing, by the electronic device, the user to position the electronic device with respect to the target object, wherein the imaging device is proximate to, and facing, the target object.

4. The method of claim 1, further comprising:

adjusting, by the imaging device, a focal length, wherein the adjusting of the focal length results in a focused image of the target object.

5. The method of claim 1, further comprising:

adjusting, by the imaging device, an aperture, wherein the adjusting of the aperture results in a focused image of the target object.

6. The method of claim 1, further comprising:

positioning the electronic device proximate the target object;

displaying, by the display, the image of the target object;

displaying, by the display, one or more stationary boundary indicators, wherein the one or more stationary boundary indicators is a graphical representation of an optimal focal distance of the imaging device;

displaying, by the display, one or more variable boundary indicators, wherein the one or more variable indicators is a graphical representation of one or more bounded areas containing the features or feature locations on the target object, and wherein the one or more variable boundary indicators move and change size about the display in response to movement of the electronic device with respect to the target object;

directing, by the portable electronic device, the user to reposition the electronic device with respect to the target object so that the one or more stationary boundary indicators substantially matches the one or more variable boundary indicators; and

whereupon the one or more stationary boundary indicators substantially matches the one or more variable boundary indicators, capturing, by the imaging device, a detailed image of the target object.

7. The method of claim 1, wherein if a model is not identified from the model database, then directing, by the electronic device, the user to reposition the electronic device to identify a second plurality of features and feature locations on the target object.

8. An electronic device, comprising:

an imaging device;

a processor;

a display; and

a computer-readable memory containing a model identifying application comprising programming instructions that instruct the processor to;

cause the imaging device to receive an image of a target object,

cause the display to display the image of the target object,

identify a plurality of features and feature locations on the target object,

access a model database to identify one or more models, each having features and feature locations that match the identified features and feature locations of the target object,

in response to identifying only one model;

retrieve one or more files from a file database that correspond to the identified model, and

provide the one or more files to a user, and

in response to identifying more than one model;

identify a potential distinguishing feature,

cause the display to display a bounded area that corresponds to a location of the potential distinguishing feature,

cause the imaging device to capture a second image of the target object,

determine whether a portion of the second image that corresponds to the bounded area comprises the potential distinguishing feature, and

in response to determining that the bounded area comprises the potential distinguishing feature;

retrieving, from the file database, one or more document files that correspond to the identified model, and

providing the one or more document files to the user.

9. The electronic device of claim 8, wherein the one or more document files comprises at least one of the following:

a brochure file, a user manual file, an instruction manual file, and a specification sheet file.

10. The electronic device of claim 8, wherein the programming instructions further instruct the processor to:

before causing the imaging device to receive an image of the target object, direct the user to position the electronic device with respect to the target object, wherein the imaging device is proximate to, and facing, the target object.

11. The electronic device of claim 8, wherein the imaging device further comprises an adjustable focal length.

12. The electronic device of claim 11, wherein the programming instructions further instruct the processor to:

before causing the imaging device to receive an image of the target object, adjust the focal length, wherein the adjusting of the focal length results in a focused image of the target object.

13. The electronic device of claim 8, wherein the imaging device further comprises an adjustable aperture.

14. The electronic device of claim 13, wherein the programming instructions further instruct the processor to:

before causing the imaging device to receive an image of the target object, adjust the aperture, wherein the adjusting of the aperture results in a focused image of the target object.

15. The electronic device of claim 8, wherein the model identifying application further comprises programming instructions that direct the processor to:

cause the electronic device to direct the user to position the electronic device proximate the target object;

cause the display to display one or more stationary boundary indicators, wherein the one or more stationary boundary indicators is a graphical representation of an optimal focal distance of the imaging device;

cause the display to display one or more variable boundary indicators, wherein the one or more variable indicators is a graphical representation of one or more bounded areas containing the features or feature locations on the target object, and wherein the one or more variable boundary indicators move and change size about the display in response to movement of the electronic device with respect to the target object;

cause the electronic device to direct the user to reposition the electronic device with respect to the target object so that the one or more stationary boundary indicators substantially matches the one or more variable boundary indicators; and

whereupon the one or more stationary boundary indicators substantially matches the one or more variable boundary indicators, cause the imaging device to capture a detailed image of the target object.

16. A non-transitory computer program product containing instructions that, when executed, instruct a processor of an electronic device to implement a method, wherein the electronic device includes an imaging device, a processor, a display, and a computer-readable memory, the method comprises:

causing the imaging device to capture an image of a target object;

causing the processor using an image recognition application to analyze the image to identify a plurality of features and feature locations;

causing the processor to access a model database to identify one or more models, each having features and feature locations that match the identified features and feature locations from the image;

in response to identifying only one model;

causing the processor to retrieve one or more files that correspond to the identified model from a file database, and

causing the processor to provide the one or more files to a user; and

in response to identifying more than one model;

causing the processor to identify a potential distinguishing feature,

causing the display to display a bounded area that corresponds to a location of the potential distinguishing feature,

causing the imaging device to capture a second image of the target object,

causing the processor to determine whether a portion of the second image that corresponds to the bounded area comprises the potential distinguishing feature, and

in response to determining that the bounded area comprises the potential distinguishing feature;

causing the processor to retrieve, from the file database, one or more document files that correspond to the identified model, and

causing the processor to provide the one or more document files to the user.

17. The computer program product of claim 16, wherein the one or more document files comprises at least one of the following:

a brochure file, a user manual file, an instruction manual file, and a specification sheet file.

18. The computer program product of claim 16, wherein the method further comprises:

before causing the imaging device to receive an image of the target object, adjusting a focal length of the imaging device, wherein the adjusting of the focal length results in a focused image of the target object.

19. The computer program product of claim 16, wherein the method further comprises:

before causing the imaging device to receive an image of the target object, adjusting an aperture of the imaging device, wherein the adjusting of the aperture results in a focused image of the target object.

20. The computer program product of claim 16, wherein the method further comprises:

causing the electronic device to direct the user to position the electronic device proximate the target object;

causing the display to display one or more stationary boundary indicators, wherein the one or more stationary boundary indicators is a graphical representation of an optimal focal distance of the imaging device;

causing the display to display one or more variable boundary indicators, wherein the one or more variable indicators is a graphical representation of one or more bounded areas containing the features or feature locations on the target object, and wherein the one or more variable boundary indicators move and change size about the display in response to movement of the electronic device with respect to the target object;

causing the electronic device to direct the user to reposition the electronic device with respect to the target object so that the one or more stationary boundary indicators substantially matches the one or more variable boundary indicators; and

whereupon the one or more stationary boundary indicators substantially matches the one or more variable boundary indicators, causing the imaging device to capture a detailed image of the target object.