Method and device for recognizing object

• US 10,133,957 B2
• Filed: 05/16/2016
• Issued: 11/20/2018
• Est. Priority Date: 05/18/2015
• Status: Active Grant

• Current Assignee: Xiaomi Inc. (Xiaomi Corp.)
• Original Assignee: Xiaomi Inc. (Xiaomi Corp.)
• Inventors: Tang, Mingyong, Chen, Tao, Liu, Huayijun
• Primary Examiner(s): Nakhjavan, Shervin
• Application Number:
  US15/155,385
• Publication Number:
  US 20160342858A1
• Time in Patent Office: 918 Days
• Field of Search: None
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 10/75 Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata

Abstract

Aspects of the disclosure include a method for indicating a location of a first object by a wearable device. The method includes determining the first object; and, when a preset condition is satisfied, locating the first object and highlighting the first object on a display.

Claims

1. A method for indicating a location of an object of interest, the method comprising:

identifying, using a wearable device or an image recognition device, a target object of a user of the wearable device;

identifying the object of interest that is associated with the target object by querying a pre-stored object association table according to the identified target object, the location of the object of interest being different from a location of the target object; and

in response to a preset condition being satisfied after identifying the object of interest, locating the object of interest and highlighting the object of interest on a display of the wearable device,

wherein the preset condition includes detection of an angle variation of the wearable device exceeding a preset angle threshold.

2. The method according to claim 1, further comprising:

receiving and saving the object association table, wherein the object association table comprises information regarding associations among various objects.

3. The method according to claim 1, further comprising:

receiving behavior information through an input interface, and saving the behavior information;

or

generating the behavior information based on detected parameters, and saving the behavior information.

4. The method according to claim 3, further comprising determining whether the preset condition is satisfied by performing one or more of:

determining a current time corresponding to a time recorded in the pre-stored behavior information;

or

determining a current location corresponding to a location recorded in the pre-stored behavior information.

5. The method according to claim 1, further comprising determining whether the preset condition is satisfied by performing:

determining whether a function of highlighting the object of interest on the display is activated.

6. The method according to claim 1, wherein highlighting the object of interest on the display comprises:

displaying the object of interest with a part or an entirety of the object of interest enlarged on the display;

or

displaying the object of interest in a flashing effect on the display.

7. The method according to claim 1, wherein the identifying the target object of the user of the wearable device comprises identifying, as the target object, an object at which the user stares for a time period.

8. A method for indicating a location of an object of interest, comprising:

recognizing, by an image recognition device, a target object of a user of a wearable device; and

sending information regarding the recognized target object to the wearable device, so that the wearable device identifies the object of interest that is associated with the target object by querying a pre-stored object association table according to the identified target object, locates the object of interest in response to a preset condition being satisfied, and highlights the object of interest on a display of the wearable device, the location of the object of interest being different from a location of the target object,

wherein the preset condition includes detection of an angle variation of the wearable device exceeding a preset angle threshold.

9. The method according to claim 8, wherein recognizing the target object comprises:

scanning for a scanned object within a current view range of the image recognition device;

determining whether the scanned object is indicated in a pre-stored object information table; and

when the scanned object is indicated in the pre-stored object information table, determining the scanned object as the target object.

10. The method according to claim 9, further comprising:

receiving and saving the object information table, wherein the object information table comprises information of one or more objects associated with the object of interest.

11. A device for indicating a location of an object of interest, comprising:

a processor; and

a memory for storing instructions executable by the processor,

wherein the processor is configured to

identify, using the device or an image recognition device, a target object of a user of the device;

identify the object of interest that is associated with the target object by querying a pre-stored object association table according to the identified target object, the location of the object of interest being different from a location of the target object; and

in response to a preset condition being satisfied after identifying the object of interest, locate the object of interest and highlight the object of interest on a display of the device,

wherein the preset condition includes detection of an angle variation of the device exceeding a preset angle threshold.

12. The device according to claim 11, wherein the processor is configured to

receive and save the object association table, wherein the object association table comprises information regarding associations among various objects.

13. The device according to claim 11, wherein the processor is configured to

receive user behavior information through an input interface, and save the behavior information;

or

generate the user behavior information based on detected parameters, and save the user behavior information.

14. The device according to claim 13, wherein the processor is configured to determine whether the preset condition is satisfied by performing one or more of

determining a current time corresponding to a time recorded in the pre-stored behavior information;

or

determining a current location corresponding to a location recorded in the pre-stored behavior information.

15. The device according to claim 11, wherein the processor is configured to determine whether the preset condition is satisfied by performing

determining whether a function of highlighting the object of interest on the display is activated.

16. The device according to claim 11, wherein, when highlighting the object of interest on the display, the processor is configured to:

display the object of interest with a part or an entirety of the object of interest enlarged on the display;

or

display the object of interest with a flashing effect on the display.

17. The device according to claim 11, wherein the processor is configured to identify, as the target object, an object at which the user stares for a time period.

18. A device for indicating a location of an object of interest, comprising:

a processor; and

a memory for storing instructions executable by the processor;

wherein the processor is configured to

recognize a target object of a user of a wearable device; and

send information regarding the recognized target object to the wearable device, so that the wearable device identifies the object of interest that is associated with the target object by querying a pre-stored object association table according to the identified target object, locates the object of interest in response to a preset condition being satisfied, and highlights the object of interest on a display of the wearable device, the location of the object of interest being different from a location of the target object,

wherein the preset condition includes detection of an angle variation of the wearable device exceeding a preset angle threshold.

19. A non-transitory computer-readable storage medium having stored therein instructions that, when executed by a processor of a wearable device, causes the wearable device to perform a method for indicating a location of an object of interest, the method comprising:

identifying, using the wearable device or an image recognition device, a target object of a user of the wearable device;

identifying the object of interest that is associated with the target object by querying a pre-stored object association table according to the identified target object, the location of the object of interest being different from a location of the target object; and

in response to a preset condition being satisfied after identifying the object of interest, locating the object of interest and highlighting the object of interest on a display of the wearable device,

wherein the preset condition includes detection of an angle variation of the wearable device exceeding a preset angle threshold.

20. A non-transitory computer-readable storage medium having stored therein instructions that, when executed by a processor of an image recognition device, causes the image recognition device to perform a method for indicating a location of an object of interest, the method comprising:

recognizing a target object of a user of a wearable device; and

sending information regarding the recognized target object to the wearable device, so that the wearable device identifies the object of interest that is associated with the target object by querying a pre-stored object association table according to the identified target object, locates the object of interest in response to a preset condition being satisfied, and highlights the object of interest on a display of the wearable device, the location of the object of interest being different from a location of the target object,

wherein the preset condition includes detection of an angle variation of the wearable device exceeding a preset angle threshold.