Systems and methods for providing object recognition based on detecting and extracting media portions

• US 10,325,154 B2
• Filed: 05/04/2017
• Issued: 06/18/2019
• Est. Priority Date: 03/12/2015
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Barak, Dan, Bar, Tomer, Chen, Kun
• Primary Examiner(s): Liew, Alex Kok S
• Application Number:
  US15/587,326
• Publication Number:
  US 20170236007A1
• Time in Patent Office: 775 Days
• Field of Search: 382115-118
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

Systems, methods, and non-transitory computer-readable media can receive a selection of an image. An object included in the image can be detected. An image portion that includes the object can be extracted from the image. The image portion can be provided for image analysis based on one or more object recognition processes. An identifier for the object can be received. The identifier can be determined based on the one or more object recognition processes being applied to the image portion.

Claims

1. A computer-implemented method comprising:

receiving, by a computing system, an image portion of an image, wherein the image portion is provided by a mobile device associated with a user remote from the computing system;

generating, by the computing system, an identifier for an object associated with the image portion of the image based on an object recognition process to which the image portion is applied;

providing, by the computing system, the identifier for the object associated with the image portion for presentation to the user with the image; and

receiving, by the computing system, the image and the identifier for the object associated with the image portion in response to a command by the user at the mobile device.

2. The computer-implemented method of claim 1,

wherein the object in the image is detected at the mobile device.

3. The computer-implemented method of claim 1, wherein the image portion comprises a set of pixels associated with the object.

4. The computer-implemented method of claim 1,

wherein the user is provided an option to modify the identifier.

5. The computer-implemented method of claim 1, wherein

a location of the object in the image is determined;

and

the identifier is overlaid on the image based on the location of the object in the image.

6. The computer-implemented method of claim 1, wherein

the object associated with the image portion of the image is detected;

a second object associated with a second image portion of the image is detected, the method further comprising;

receiving the image portion and the second image portion from the mobile device to generate, respectively, the identifier and a second identifier based on the object recognition process to which the image portion and the second image portion are applied.

7. The computer-implemented method of claim 1, wherein the object comprises a face of a person represented in the image, the object recognition process comprises a facial recognition process, and the identifier comprises a name associated with the person.

8. The computer-implemented method of claim 7, wherein the facial recognition process is based at least in part on a people clustering process.

9. The computer-implemented method of claim 7, wherein the user is associated with a set of social connections via the networking system and the facial recognition process is based at least in part on one or more face models associated with a subset of social connections out of the set of social connections.

10. The computer-implemented method of claim 9, wherein the subset of social connections is associated with a ranking of the set of social connections, the ranking based on at least one of a social coefficient metric, a social affinity metric, a social interaction recency metric, and location data.

11. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform;

receiving an image portion of an image, wherein the image portion is provided by a mobile device associated with a user remote from the computing system;

generating an identifier for an object associated with the image portion of the image based on an object recognition process to which the image portion is applied;

providing the identifier for the object associated with the image portion for presentation to the user with the image; and

receiving the image and the identifier for the object associated with the image portion in response to a command by the user at the mobile device.

12. The system of claim 11, wherein

the object in the image is detected at the mobile device.

13. The system of claim 11, wherein the image portion comprises a set of pixels associated with the object.

14. The system of claim 11, wherein

the user is provided an option to modify the identifier.

15. The system of claim 11, wherein

a location of the object in the image is determined;

and

the identifier is overlaid on the image based on the location of the object in the image.

16. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform:

receiving an image portion of an image, wherein the image portion is provided by a mobile device associated with a user remote from the computing system;

generating an identifier for an object associated with the image portion of the image based on an object recognition process to which the image portion is applied;

providing the identifier for the object associated with the image portion for presentation to the user with the image; and

receiving the image and the identifier for the object associated with the image portion in response to a command by the user at the mobile device.

17. The non-transitory computer-readable storage medium of claim 16, wherein

the object in the image is detected at the mobile device.

18. The non-transitory computer-readable storage medium of claim 16, wherein the image portion comprises a set of pixels associated with the object.

19. The non-transitory computer-readable storage medium of claim 16, wherein

the user is provided an option to modify the identifier.

20. The non-transitory computer-readable storage medium of claim 16, wherein

a location of the object in the image is determined;

and

the identifier is overlaid on the image based on the location of the object in the image.