Apparatus and method for providing information associated with object

• US 10,209,514 B2
• Filed: 06/19/2015
• Issued: 02/19/2019
• Est. Priority Date: 06/20/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Kang, Woo-sung
• Primary Examiner(s): Lopez, Jose Soto
• Application Number:
  US14/744,603
• Publication Number:
  US 20150370070A1
• Time in Patent Office: 1,341 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted

Abstract

A method of operating a device is provided. The method includes acquiring an image, determining whether an object registered in a device exists in the image, and if it is determined that the registered object exists in the image, displaying associated information of the registered object.

Claims

1. An operating method of a device, the method comprising:

acquiring an image comprising a scene around a user of the device;

determining whether a pre-registered object exists in the acquired image, the object being pre-registered in the device by detecting from another image acquired by the device based on a preset criterion;

in response to determining that the pre-registered object does not exist in the acquired image, comparing a detection frequency which the object is detected and an elapsed time from when the object was last detected; and

if the pre-registered object does not exist in the acquired image and the elapsed time from when the object was last detected is longer than the detection frequency which the object is detected, displaying an information reminding the user of the device about the pre-registered object,

wherein the detection frequency is an average time until the object detected from the acquired image is re-detected.

2. The method of claim 1, wherein the object is registered based on at least one selected from a detection frequency indicating a number of times the object appears in the image acquired by the device and an interaction frequency indicating a number of times the object contacts the user of the device in the acquired image.

3. The method of claim 1, further comprising:

displaying associated information of the registered object, upon determining that the registered object exists in the image.

4. The method of claim 1, wherein the information about the registered object comprises a most recent image from which the registered object is detected.

5. The method of claim 3, wherein the associated information comprises information about at least one object associated with the registered object.

6. The method of claim 4, wherein the information about the at least one object comprises a most recent image from which the at least one object is detected.

7. The method of claim 3, wherein the associated information comprises information that is input for the registered object by the user.

8. The method of claim 3, wherein the registered object indicates a place, and the associated information comprises information about at least one object associated with the registered object.

9. The method of claim 8, wherein the displaying of the associated information comprises displaying information about at least one object associated with the registered object with reference to a time interval between a detection time of the registered object and a detection time of the at least one object associated with the registered object.

10. The method of claim 8, wherein the associated information comprises a most recent image from which at least one object associated with the registered object is detected.

11. The method of claim 3, wherein the registered object indicates a place, and the associated information comprises information that is input for the registered object by the user.

12. A non-transitory computer-readable recording medium having recorded thereon a program for executing by at least one processor the method of claim 1.

13. A device comprising:

a display;

a camera; and

a controller configured to;

acquire an image comprising a scene around a user of the device by the camera,

determine whether a pre-registered object exists in the acquired image, the object being pre-registered in the device by detecting from another image acquired by the device based on a preset criterion,

in response to determining that the pre-registered object does not exist in the acquired image, compare a detection frequency which the object is detected and an elapsed time from when the object was last detected, and

if the pre-registered object does not exist in the acquired image and the elapsed time from when the object was last detected is longer than the detection frequency which the object is detected, display an information reminding the user of the device about the pre-registered object,

wherein the detection frequency is an average time until the object detected from the acquired image is re-detected.

14. The device of claim 13, wherein the object is registered based on at least one selected from a detection frequency indicating a number of times the object appears in the image acquired by the device and an interaction frequency indicating a number of times the object contacts the user of the device in the acquired image.

15. The device of claim 13, wherein the controller is further configured to control to display associated information of the registered object, upon determining that the registered object exists in the image, and

wherein the display unit is further configured to display the associated information.

16. The device of claim 13, wherein the information about the registered object comprises a most recent image from which the registered object is detected.

17. The device of claim 15, wherein the associated information comprises information about at least one object associated with the registered object.

18. The device of claim 16, wherein the information about the at least one object comprises a most recent image from which the at least one object is detected.

19. The device of claim 15, wherein the associated information comprises information that is input for the registered object by the user.

20. The device of claim 15, wherein the registered object indicates a place, and the associated information comprises information about at least one object associated with the registered object.

21. The device of claim 20, wherein the controller is further configured to control to display information about at least one object associated with the registered object, with reference to a time interval between a detection time of the registered object and a detection time of at least one object associated with the registered object.

22. The device of claim 20, wherein the associated information comprises a most recent image from which at least one object associated with the registered object is detected.

23. The device of claim 15, wherein the registered object indicates a place, and the associated information comprises information about the registered object based on an input of the user.