System, method, and computer program product for performing processing based on object recognition

• US 9,336,435 B1
• Filed: 12/24/2014
• Issued: 05/10/2016
• Est. Priority Date: 11/21/2012
• Status: Expired due to Fees

• Current Assignee: Boccone, LLC (Oso IP, LLC)
• Original Assignee: Ozog Media, LLC
• Inventors: Ozog, Jesse
• Primary Examiner(s): Riegler, Patrick
• Application Number:
  US14/582,946
• Time in Patent Office: 503 Days
• Field of Search: 715/764
• US Class Current: 1/1
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks

Abstract

A system, method, and computer program product are provided for providing suggestions based on object recognition. In operation, at least one option for adding at least one additional indicia for being displayed among the indicia is displayed, utilizing the touchscreen of the mobile device. Additionally, a user input is received in connection with the at least one option, utilizing the touchscreen of the mobile device. Still yet, after receiving the user input in connection with the at least one option for, a plurality of suggestions is identified, utilizing the at least one processor of the mobile device. The suggestions each correspond with at least one face that has been recognized in at least one of a plurality of images accessible via the mobile device.

Claims

1. A computer program product embodied on a non-transitory computer readable medium, comprising:

code for displaying a plurality of indicia each including at least a portion of an image including a face, utilizing a touchscreen of a mobile device;

code for receiving a user input in connection with at least one of the indicia including at least a portion of a first image including a first face, utilizing the touchscreen of the mobile device;

code for, after receiving the user input in connection with the at least one indicia, identifying a plurality of images associated with the first face based on facial recognition, utilizing at least one processor of the mobile device;

code for displaying the images associated with the first face based on the facial recognition, utilizing the touchscreen of the mobile device;

code for displaying at least one option for adding at least one additional indicia among the plurality of indicia each including the at least portion of the image including the face, utilizing the touchscreen of the mobile device;

code for receiving a user input in connection with the at least one option for adding the at least one additional indicia among the indicia, utilizing the touchscreen of the mobile device;

code for, after receiving the user input in connection with the at least one option for adding the at least one additional indicia among the indicia, identifying a plurality of suggestions, utilizing the at least one processor of the mobile device, the suggestions each corresponding with at least one face that has been recognized in at least one of a plurality of images accessible via the mobile device utilizing face recognition information that is based on third party input of a third party that is inputted by the third party into at least one other device in association with one or more faces, the face recognition information being received at the mobile device based on a relation between a user of the mobile device and the third party associated with the third party input, such that the face recognition information is only received at the mobile device if the relation exists between the user of the mobile device and the third party associated with the third party input;

code for displaying the suggestions, utilizing the touchscreen of the mobile device;

code for receiving a user input in connection with at least one of the suggestions, utilizing the touchscreen of the mobile device; and

code for, after receiving the user input in connection with the at least one suggestion, displaying the at least one additional indicia associated with the at least one face among the indicia, utilizing the touchscreen of the mobile device.

2. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the at least one additional indicia includes the at least one face.

3. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the at least one additional indicia includes a textual identifier associated with the at least one face.

4. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the suggestions each include a corresponding face.

5. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the suggestions each include a textual identifier associated with a corresponding face.

6. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the suggestions are displayed utilizing a scroll menu.

7. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the suggestions are prioritized.

8. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the suggestions each correspond with the at least one face that has been recognized in at least one of the images accessible via the mobile device, utilizing face recognition information based on input of a user of the mobile device.

9. The computer program product as set forth in claim 8, wherein the computer program product is operable such that the face recognition information based on the input of the user of the mobile device is received after receiving a user input in connection with at least one other option displayed utilizing the touchscreen of the mobile device.

10. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the at least one image is accessible via the mobile device by being stored in memory of the mobile device.

11. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the at least one image is accessible via the mobile device by being received over a network interface of the mobile device.

12. The computer program product as set forth in claim 1, and further comprising:

code for receiving a user input in connection with the at least one additional indicia, utilizing the touchscreen of the mobile device;

code for, after receiving the user input in connection with the at least one additional indicia, identifying a plurality of particular images associated with the at least one face based on the facial recognition, utilizing at least one processor of the mobile device; and

code for displaying the particular images associated with the first face based on the facial recognition, utilizing the touchscreen of the mobile device.

13. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the user input is received in connection with the at least one indicia as a result of detecting a touch of a user'"'"'s finger within a predetermined proximity to the at least one indicia displayed utilizing the touchscreen of the mobile device.

14. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the plurality of indicia is displayed via a face home screen showing a plurality of faces for accessing images including a selected one or more of the faces, and the at least one option is for adding one or more new faces to the face home screen for accessing images including the one or more new faces upon the selection thereof.

15. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the third party input includes training input that is input on another mobile device for generating the face recognition information that is capable of being used for identifying faces in images.

16. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the relation is established based on an invitation and an acceptance of the invitation.

17. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the relation is established based on a request and a response the request.

18. The computer program product as set forth in claim 1, wherein the computer program product is operable such that the relation is established based on a request for images with one or more particular faces and a response the request.

19. An apparatus, comprising:

a mobile device configured for;

displaying a plurality of indicia each including at least a portion of an image including a face, utilizing a touchscreen of the mobile device;

receiving a user input in connection with at least one of the indicia including at least a portion of a first image including a first face, utilizing the touchscreen of the mobile device;

after receiving the user input in connection with the at least one indicia, identifying a plurality of images associated with the first face based on facial recognition, utilizing at least one processor of the mobile device;

displaying the images associated with the first face based on the facial recognition, utilizing the touchscreen of the mobile device;

displaying at least one option for adding at least one additional indicia among the plurality of indicia each including the at least portion of the image including the face, utilizing the touchscreen of the mobile device;

receiving a user input in connection with the at least one option for adding the at least one additional indicia among the indicia, utilizing the touchscreen of the mobile device;

after receiving the user input in connection with the at least one option for adding the at least one additional indicia among the indicia, identifying a plurality of suggestions, utilizing the at least one processor of the mobile device, the suggestions each corresponding with at least one face that has been recognized in at least one of a plurality of images accessible via the mobile device utilizing face recognition information that is based on third party input of a third party that is inputted by the third party into at least one other device in association with one or more faces, the face recognition information being received at the mobile device based on a relation between a user of the mobile device and the third party associated with the third party input, such that the face recognition information is only received at the mobile device if the relation exists between the user of the mobile device and the third party associated with the third party input;

displaying the suggestions, utilizing the touchscreen of the mobile device;

receiving a user input in connection with at least one of the suggestions, utilizing the touchscreen of the mobile device; and

after receiving the user input in connection with the at least one suggestion, displaying the at least one additional indicia associated with the at least one face among the indicia, utilizing the touchscreen of the mobile device.

20. A method, comprising:

displaying a plurality of indicia each including at least a portion of an image including a face, utilizing a touchscreen of a mobile device;

receiving a user input in connection with at least one of the indicia including at least a portion of a first image including a first face, utilizing the touchscreen of the mobile device;

after receiving the user input in connection with the at least one indicia, identifying a plurality of images associated with the first face based on facial recognition, utilizing at least one processor of the mobile device;

displaying the images associated with the first face based on the facial recognition, utilizing the touchscreen of the mobile device;

displaying at least one option for adding at least one additional indicia among the plurality of indicia each including the at least portion of the image including the face, utilizing the touchscreen of the mobile device;

receiving a user input in connection with the at least one option for adding the at least one additional indicia among the indicia, utilizing the touchscreen of the mobile device;

after receiving the user input in connection with the at least one option for adding the at least one additional indicia among the indicia, identifying a plurality of suggestions, utilizing the at least one processor of the mobile device, the suggestions each corresponding with at least one face that has been recognized in at least one of a plurality of images accessible via the mobile device utilizing face recognition information that is based on third party input of a third party that is inputted by the third party into at least one other device in association with one or more faces, the face recognition information being received at the mobile device based on a relation between a user of the mobile device and the third party associated with the third party input, such that the face recognition information is only received at the mobile device if the relation exists between the user of the mobile device and the third party associated with the third party input;

displaying the suggestions, utilizing the touchscreen of the mobile device;

receiving a user input in connection with at least one of the suggestions, utilizing the touchscreen of the mobile device; and

after receiving the user input in connection with the at least one suggestion, displaying the at least one additional indicia associated with the at least one face among the indicia, utilizing the touchscreen of the mobile device.