Systems and methods for identifying objects and providing information related to identified objects

• US 10,373,013 B2
• Filed: 05/07/2018
• Issued: 08/06/2019
• Est. Priority Date: 01/03/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Rosenblatt, Michael Nathaniel
• Primary Examiner(s): Johns, Andrew W
• Application Number:
  US15/973,115
• Publication Number:
  US 20180253623A1
• Time in Patent Office: 456 Days
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04N 5/76 Television signal recording

Abstract

Systems and methods for identifying an object and presenting additional information about the identified object are provided. The techniques of the present invention can allow the user to specify modes to help with identifying objects. Furthermore, the additional information can be provided with different levels of detail depending on user selection. Apparatus for presenting a user with a log of the identified objects is also provided. The user can customize the log by, for example, creating a multi-media album.

Claims

1. A system comprising:

a data source; and

an electronic device comprising;

an output component;

object detection technology operative to detect an object in an environment of the electronic device;

an identification module operative to communicate a search request to the data source for obtaining identification information from the data source about the detected object; and

a processor operative to;

select a mode of the electronic device; and

present at least a portion of the obtained identification information for the detected object to a user via the output component, wherein the selected mode specifies at least one parameter of the search request configured to be used for searching the data source for obtaining the identification information from the data source.

2. The system of claim 1, wherein:

the electronic device further comprises location detection technology operative to detect the location of the electronic device when the object is detected; and

the detected location of the electronic device when the object is detected specifies at least one other parameter of the search request configured to be used for searching the data source for obtaining the identification information from the data source.

3. The system of claim 2, wherein the location detection technology comprises a global positioning system receiver.

4. The system of claim 1, wherein the data source is remote from the electronic device.

5. The system of claim 1, wherein the identification information comprises at least one user-selectable option for providing additional information about the detected object.

6. The system of claim 1, wherein the identification information comprises at least two user-selectable options for providing different types of additional information about the detected object.

7. The system of claim 1, wherein the object detection technology comprises a camera, and wherein the output component comprises a visual display.

8. The system of claim 1, wherein the data source comprises an information database of multi-media data from which the identification information is obtained using a search based on the selected mode.

9. The system of claim 1, wherein the processor is operative to simultaneously present the identification information for the detected object and an image of the detected object via the output component.

10. The system of claim 9, wherein the identification information comprises at least two user-selectable options.

11. The system of claim 10, wherein each one of the at least two user-selectable options is operative to provide additional unique information associated with the detected object when selected by the user.

12. The system of claim 9, wherein the identification information comprises at least one link to a website comprising additional information associated with the detected object.

13. The system of claim 9, wherein the object detection technology comprises a camera operative to capture the image, and wherein the output component comprises a visual display.

14. The system of claim 1, wherein the identification information comprises at least one link to a website comprising additional information associated with the detected object.

15. The system of claim 1, wherein:

the selected mode is implemented as at least one metadata tag; and

each of the at least one metadata tag specifies at least one of the at least one parameter of the search request configured to be used for searching the data source for obtaining the identification information from the data source.

16. The system of claim 1, wherein the processor is operative to enable a user to select the mode of the electronic device.

17. The system of claim 1, wherein:

the processor is further operative to select an other mode of the electronic device in addition to the mode of the electronic device; and

the selected other mode specifies at least one other parameter of the search request configured to be used for searching the data source for obtaining the identification information from the data source.

24. The method of claim 9, wherein the automatically obtaining the identification information comprises automatically obtaining the identification information from a data source remote from the electronic device.

18. A system comprising:

a data source; and

an electronic device comprising;

an output component;

object detection technology operative to detect an object in an environment of the electronic device;

an identification module operative to communicate with the data source for obtaining identification information from the data source about the detected object; and

a processor operative to;

select a mode of the electronic device; and

present the identification information for the detected object to a user via the output component, wherein the data source comprises an information database of multi-media data from which the identification information is obtained using the selected mode of the electronic device.

19. A method for operating an electronic device that comprises object detection technology, an output component, and a processor, the method comprising:

detecting an object in an environment of the electronic device using the object detection technology;

selecting at least one mode of the electronic device;

in response to the detecting and the selecting, automatically obtaining, using the processor, identification information associated with both the detected object and the at least one selected mode; and

presenting data, using the output component, wherein the presented data comprises at least a portion of the obtained identification information.

20. The method of claim 19, wherein the data further comprises a user-selectable option.

21. The method of claim 20, wherein, when the user-selectable option is selected, presenting, using the output component, other data comprising additional identification information associated with the detected object.

22. The method of claim 21, wherein the additional identification information comprises another portion of the obtained identification information.

23. The method of claim 20, wherein the user-selectable option comprises a link to a website comprising additional information associated with the detected object.

25. The method of claim 19, wherein the data further comprises an image of the detected object.

26. The method of claim 19, further comprising determining a location of the electronic device when the objected was detected using location detection technology of the electronic device, wherein the automatically obtaining the identification information comprises automatically obtaining the identification information that is associated with not only the detected object and the at least one selected mode but also the determined location.