HANDHELD DEVICE AND METHOD FOR DISPLAYING OPERATION MANUAL

• US 20140023229A1
• Filed: 07/04/2013
• Published: 01/23/2014
• Est. Priority Date: 07/20/2012
• Status: Abandoned Application

• Current Assignee: Hon Hai Precision Industry Co., Ltd.
• Original Assignee: Hon Hai Precision Industry Co., Ltd.
• Inventors: LEE, HOU-HSIEN, LEE, CHANG-JUNG, LO, CHIH-PING
• Application Number:
  US13/935,513
• Publication Number:
  US 20140023229A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

In a method for displaying an operation manual of a component of a product using a handheld device. An image of the component is captured by an image capturing device of the handheld device. The captured image is compared with each image template stored in an image template database to determine a matching image corresponding to the captured image in the image template database, and contents of the operation manual of the component corresponding to the matching image are displayed on a display screen of the handheld device.

Claims

1. A computer-implemented method of a handheld device comprising a display screen, the method comprising:

obtaining an image of a component of a product captured by an image capturing device of the handheld device, and displaying the captured image in a preset detection area of the display screen;

comparing the captured image in the preset detection area with image templates stored in an image template database, and determining a matching image corresponding to the captured image in the image template database; and

displaying contents of an operation manual of the component corresponding to the matching image on the display screen.

2. The method according to claim 1, further comprising:

determining a type of the product by scanning a barcode of the product.

3. The method according to claim 1, further comprising:

adjusting a display size and a display shape of the preset detection area according to a type of the product and a shape of the component.

4. The method according to claim 1, wherein the matching image is determined by:

calculating a similarity between the captured image and each of the image templates stored in the image template database; and

determining a specified image template as the matching image upon the condition that the similarity between the captured image and the specified image template is greater than a preset value.

5. The method according to claim 1, wherein the contents of the operation manual of the component are displayed on the display screen in an augmented reality mode.

6. A handheld device, comprising:

a processor;

a display screen;

a storage device storing a plurality of instructions, which when executed by the processor, causes the processor to;

obtain an image of a component of a product using an image capturing device of the handheld device, and display the captured image in a preset detection area of the display screen;

compare the captured image in the preset detection area with image templates stored in an image template database, and determine a matching image corresponding to the captured image in the image template database; and

display contents of an operation manual of the component corresponding to the matching image on the display screen.

7. The handheld device according to claim 6, wherein the plurality of instructions further comprise:

determining a type of the product by scanning a barcode of the product.

8. The handheld device according to claim 6, wherein the plurality of instructions further comprise:

adjusting a display size and a display shape of the preset detection area according to a type of the product and a shape of the component.

9. The handheld device according to claim 6, wherein the matching image is determined by:

calculating a similarity between the captured image and each of the image templates stored in the image template database; and

determining a specified image template as the matching image upon the condition that the similarity between the captured image and the specified image template is greater than a preset value.

10. The handheld device according to claim 6, wherein the contents of the operation manual of the component are displayed on the display screen in an augmented reality mode.

11. A non-transitory storage medium having stored thereon instructions that, when executed by a processor of a handheld device, causes the handheld device to perform a method, the method comprising:

obtaining an image of a component of a product captured by an image capturing device of the handheld device, and displaying the captured image in a preset detection area of a display screen of the handheld device;

comparing the captured image in the preset detection area with image templates stored in an image template database, and determining a matching image corresponding to the captured image in the image template database; and

displaying contents of an operation manual of the component corresponding to the matching image on the display screen.

12. The non-transitory storage medium according to claim 11, wherein the method further comprises:

determining a type of the product by scanning a barcode of the product.

13. The non-transitory storage medium according to claim 11, wherein the method further comprises:

adjusting a display size and a display shape of the preset detection area according to a type of the product and a shape of the component.

14. The non-transitory storage medium according to claim 11, wherein the matching image is determined by:

calculating a similarity between the captured image and each of the image templates stored in the image template database; and

determining a specified image template as the matching image upon the condition that the similarity between the captured image and the specified image template is greater than a preset value.

15. The non-transitory storage medium according to claim 11, wherein the contents of the operation manual of the component are displayed on the display screen in an augmented reality mode.