Embedding Biometric Data From a Wearable Computing Device in Metadata of a Recorded Image

• US 20160048722A1
• Filed: 05/05/2014
• Published: 02/18/2016
• Est. Priority Date: 05/05/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tayeh, Ahmed, Barzangi, Nabaz, Attariani, Mostafa, Jensen, Mathias, Terra Rios, Rodrigo
• Granted Patent: US 9,594,403 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G06V 40/179 metadata assisted face recognition
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/52 including functional features of a camera

Abstract

According to an example method implemented by an imaging device, an image is recorded of a subject to which a wearable computing device is secured. Responsive to the recording, the imaging device wirelessly receives data from the wearable computing device. The data includes an identifier of the wearable computing device and biometric data of the subject. The identifier and biometric data are embedded as metadata in the recorded image.

Claims

1-20. -20. (canceled)

21. A method implemented by an imaging device, comprising:

recording an image of a subject to which a wearable computing device is secured;

responsive to the recording, wirelessly receiving data from the wearable computing device, the data including an identifier of the wearable computing device and biometric data of the subject; and

embedding the identifier and the biometric data as metadata in the recorded image.

22. The method of claim 21, wherein recording the image comprises transmitting a request for biometric data to the wearable computing device.

23. The method of claim 21, wherein the biometric data includes an address of a biometric data server from which biometric data of the subject can be retrieved based on the device identifier.

24. The method of claim 21, wherein the biometric data includes one or more sensor readings recorded by the wearable computing device.

25. The method of claim 21, wherein the biometric data includes one or more mood indicators derived from sensor readings recorded by the wearable computing device.

26. The method claim 21, further comprising:

estimating a position of the subject within the recorded image; and

embedding an indication of the position as metadata in the recorded image.

27. The method of claim 26, wherein estimating a position of the subject within the recorded image comprises:

receiving a reference image of the subject'"'"'s face from the wearable computing device; and

performing a facial recognition algorithm to determine the position of the subject within the recorded image based on the reference image.

28. A method implemented by a media server, comprising:

obtaining an image of a subject;

determining a timestamp and device identifier from metadata embedded in the image;

sending a request to a biometric data server to obtain biometric data, the request including the timestamp and the device identifier;

responsive to the sending, receiving biometric data that comprises a mood indication for the subject as depicted in the image; and

linking the image and the mood indication to a user account associated with the device identifier.

29. The method of claim 28, further comprising:

determining a location of the subject within the image from additional metadata embedded in the image;

wherein linking the image and the mood indication to a user account associated with the device identifier also includes linking the location of the subject within the image to the user account.

30. The method of claim 28, further comprising:

receiving a user request for images of the subject in which the subject is depicted in a specified mood;

based on the user request, determining a collection of images of the subject in which the subject is depicted in the specified mood; and

transmitting an indication of the collection of images as a response to the user request.

31. An imaging device, comprising:

a camera; and

one or more processing circuits configured to;

record an image of a subject to which a wearable computing device is secured, wherein the image is recorded using the camera;

responsive to the recording, wirelessly receive data from the wearable computing device, the data including an identifier of the wearable computing device and biometric data of the subject; and

embed the identifier and the biometric data as metadata in the recorded image.

32. The imaging device of claim 31, wherein to record the image, the one or more processing circuits are configured to transmit a request for biometric data to the wearable computing device.

33. The imaging device of claim 31, wherein the biometric data includes an address of a biometric data server from which biometric data of the subject can be retrieved based on the device identifier.

34. The imaging device of claim 31, wherein the biometric data includes one or more sensor readings recorded by the wearable computing device.

35. The imaging device of claim 31, wherein the biometric data includes one or more mood indicators derived from sensor readings recorded by the wearable computing device.

36. The imaging device of claim 31, wherein the one or more processing circuits are further configured to:

estimate a position of the subject within the recorded image; and

embed an indication of the position as metadata in the recorded image.

37. The imaging device of claim 36, wherein to estimate a position of the subject within the recorded image, the one or more processing circuits are configured to:

receive a reference image of the subject'"'"'s face from the wearable computing device; and

perform a facial recognition algorithm to determine the position of the subject within the recorded image based on the reference image.

38. A media server comprising:

a communication interface; and

one or more processing circuits configured to;

obtain an image of a subject via the communication interface;

determine a timestamp and device identifier from metadata embedded in the image;

send a request to a biometric data server to obtain biometric data, the request including the timestamp and the device identifier;

responsive to the sending, receive biometric data that comprises a mood indication for the subject as depicted in the image; and

link the image and the mood indication to a user account associated with the device identifier.

39. The media server of claim 38, wherein the one or more processing circuits are further configured to:

determine a location of the subject within the image from additional metadata embedded in the image; and

link the location of the subject within the image to the user account.

40. The media server of claim 38, wherein the one or more processing circuits are further configured to:

receive a user request for images of the subject in which the subject is depicted in a specified mood;

based on the user request, determine a collection of images of the subject in which the subject is depicted in the specified mood; and

transmit an indication of the collection of images as a response to the user request.