Embedding biometric data from a wearable computing device in metadata of a recorded image

• US 9,594,403 B2
• Filed: 05/05/2014
• Issued: 03/14/2017
• Est. Priority Date: 05/05/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Attariani, Mostafa, Jensen, Mathias, Terra Rios, Rodrigo, Tayeh, Ahmed, Barzangi, Nabaz
• Primary Examiner(s): Mehta, Bhavesh
• Assistant Examiner(s): Zohrabyan, Narek
• Application Number:
  US14/647,350
• Publication Number:
  US 20160048722A1
• Time in Patent Office: 1,044 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G06V 40/179 metadata assisted face recognition
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/52 including functional features of a camera

Abstract

According to an example method implemented by an imaging device, an image is recorded of a subject to which a wearable computing device is secured. Responsive to the recording, the imaging device wirelessly receives data from the wearable computing device. The data includes an identifier of the wearable computing device and biometric data of the subject. The identifier and biometric data are embedded as metadata in the recorded image.

Claims

1. A method implemented by an imaging device, comprising:

recording an image of a subject to which a wearable computing device is secured;

responsive to the recording, wirelessly receiving data from the wearable computing device, the data including an identifier of the wearable computing device and biometric data of the subject; and

embedding the identifier and the biometric data as metadata in the recorded image;

estimating a position of the subject within the recorded image by;

receiving a reference image of the subject'"'"'s face from the wearable computing device; and

performing a facial recognition algorithm to determine the position of the subject within the recorded image based on the reference image; and

embedding an indication of the position as metadata in the recorded image.

2. The method of claim 1, wherein recording the image comprises transmitting a request for biometric data to the wearable computing device.

3. The method of claim 1, wherein the biometric data includes an address of a biometric data server from which biometric data of the subject can be retrieved based on the device identifier.

4. The method of claim 1, wherein the biometric data includes one or more sensor readings recorded by the wearable computing device.

5. The method of claim 1, wherein the biometric data includes one or more mood indicators derived from sensor readings recorded by the wearable computing device.

6. A method implemented by a media server, comprising:

obtaining an image of a subject;

determining a timestamp and device identifier from metadata embedded in the image;

sending a request to a biometric data server to obtain biometric data, the request including the timestamp and the device identifier;

responsive to the sending, receiving biometric data that comprises a mood indication for the subject as depicted in the image; and

linking the image and the mood indication to a user account associated with the device identifier.

7. The method of claim 6, further comprising:

determining a location of the subject within the image from additional metadata embedded in the image;

wherein linking the image and the mood indication to a user account associated with the device identifier also includes linking the location of the subject within the image to the user account.

8. The method of claim 6, further comprising:

receiving a user request for images of the subject in which the subject is depicted in a specified mood;

based on the user request, determining a collection of images of the subject in which the subject is depicted in the specified mood; and

transmitting an indication of the collection of images as a response to the user request.

9. An imaging device, comprising:

a camera; and

one or more processing circuits configured to;

record an image of a subject to which a wearable computing device is secured, wherein the image is recorded using the camera;

responsive to the recording, wirelessly receive data from the wearable computing device, the data including an identifier of the wearable computing device and biometric data of the subject;

embed the identifier and the biometric data as metadata in the recorded image;

estimate a position of the subject within the recorded image by;

receiving a reference image of the subject'"'"'s face from the wearable computing device; and

performing a facial recognition algorithm to determine the position of the subject within the recorded image based on the reference image; and

embed an indication of the position as metadata in the recorded image.

10. The imaging device of claim 9, wherein to record the image, the one or more processing circuits are configured to transmit a request for biometric data to the wearable computing device.

11. The imaging device of claim 9, wherein the biometric data includes an address of a biometric data server from which biometric data of the subject can be retrieved based on the device identifier.

12. The imaging device of claim 9, wherein the biometric data includes one or more sensor readings recorded by the wearable computing device.

13. The imaging device of claim 9, wherein the biometric data includes one or more mood indicators derived from sensor readings recorded by the wearable computing device.

14. A media server comprising:

a communication interface; and

one or more processing circuits configured to;

obtain an image of a subject via the communication interface;

determine a timestamp and device identifier from metadata embedded in the image;

send a request to a biometric data server to obtain biometric data, the request including the timestamp and the device identifier;

responsive to the sending, receive biometric data that comprises a mood indication for the subject as depicted in the image; and

link the image and the mood indication to a user account associated with the device identifier.

15. The media server of claim 14, wherein the one or more processing circuits are further configured to:

determine a location of the subject within the image from additional metadata embedded in the image; and

link the location of the subject within the image to the user account.

16. The media server of claim 14, wherein the one or more processing circuits are further configured to:

receive a user request for images of the subject in which the subject is depicted in a specified mood;

based on the user request, determine a collection of images of the subject in which the subject is depicted in the specified mood; and

transmit an indication of the collection of images as a response to the user request.