Wearable terminal device, photographing system, and photographing method

• US 10,142,598 B2
• Filed: 05/30/2014
• Issued: 11/27/2018
• Est. Priority Date: 05/30/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Mobile Communications Incorporated (Sony Group Corp.)
• Inventors: Yajima, Chikashi
• Primary Examiner(s): Aynalem, Nathnael
• Application Number:
  US14/291,197
• Publication Number:
  US 20150350536A1
• Time in Patent Office: 1,642 Days
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A wearable terminal device includes circuitry configured to receive sensor data from one or more sensors, wherein the sensor data corresponds to a behavior of a user in possession of the wearable terminal device. The circuitry is configured to determine, based on the sensor data, the behavior of the user. The circuitry is configured to control, based on the determined behavior of the user, a photographing interval of a camera.

Claims

1. A wearable terminal device comprising:

circuitry configured to

receive sensor data from one or more sensors, wherein the sensor data corresponds to a behavior of a user who is wearing the wearable terminal device;

determine, based on the behavior of the user, a corresponding rate of change in an environment surrounding the wearable terminal device;

capture an image by a camera of the wearable terminal device;

identify a plurality of persons in the captured image;

identify a predetermined relationship with at least one of the plurality of persons identified in the captured image; and

control, based on the determined rate of change of the environment and the predetermined relationship, a photographing interval of the camera.

2. The wearable terminal device of claim 1, wherein

the photographing interval of the camera determines the frequency at which the camera performs automatic capturing of image data.

3. The wearable terminal device of claim 1, wherein

the one or more sensors include at least one motion sensor.

4. The wearable terminal device of claim 3, wherein

the sensor data includes an indication of a motion of one or more of the wearable terminal device and the user, and

the circuitry is further configured to determine the behavior of the user based on the indication of the motion.

5. The wearable terminal device of claim 4, wherein

the circuitry is configured to decrease the photographing interval based on an increase in the rate of change of the environment surrounding the wearable terminal device.

6. The wearable terminal device of claim 4, wherein:

the one or more sensors include at least one geospatial positioning sensor, and

the circuitry is further configured to determine the behavior of the user based on the indication of the motion and a location input received from the at least one geospatial positioning sensor.

7. The wearable terminal device of claim 6, wherein

the circuitry is configured to decrease the photographing interval when a change in the location input increases.

8. The wearable terminal device of claim 4, wherein:

the one or more sensors include at least one biological sensor configured to generate biological sensor data based on a physiological state of the user, and

the circuitry is further configured to determine the behavior of the user based on the indication of the motion and the biological sensor data.

9. The wearable terminal device of claim 4, wherein

the photographing interval of the camera determines the frequency at which the camera performs automatic capturing of image data,

the circuitry is configured to perform image analysis of each image included in the image data captured by the camera, and

the circuitry is further configured to determine the behavior of the user based on the indication of the motion and a result of the image analysis.

10. The wearable terminal device of claim 9, wherein

the result of the image analysis includes an indication of temporal changes in the image data.

11. The wearable terminal device of claim 9, wherein:

the circuitry is configured to recognize one or more faces in the image data, and

the circuitry is further configured to determine the behavior of the user based on the indication of the motion and the one or more faces recognized in the image data.

12. The wearable terminal device of claim 1, wherein

the camera is included in the wearable terminal device.

21. The wearable terminal device of claim 1, wherein the circuitry is further configured to control the photographing interval of the camera based on an emotional state of the identified person.

13. A method of adjusting a photographing interval of a camera, the method comprising:

receiving by circuitry, sensor data from one or more sensors, wherein the sensor data corresponds to a behavior of a user who is wearing the wearable terminal device;

determining, based on the behavior of the user, a corresponding rate of change in an environment surrounding the wearable terminal device;

capturing an image by a camera of the wearable terminal device;

identifying a plurality of persons in the captured image;

identifying a predetermined relationship with at least one of the plurality of persons identified in the captured image; and

controlling by circuitry, based on the determined rate of change of the environment and the predetermined relationship, the photographing interval of the camera.

14. The method of claim 13, further comprising:

decreasing by circuitry, the photographing interval based on an increase in the rate of change of the environment surrounding the wearable terminal device.

15. The method of claim 13, wherein the one or more sensors include at least one geospatial positioning sensor.

16. The method of claim 15, further comprising:

determining the behavior of the user based on the indication of the motion and a location input received from the at least one geospatial positioning sensor; and

decreasing by circuitry, the photographing interval when a change in the location input increases.

17. A non-transitory computer readable medium having stored thereon a program that when executed by a computer causes the computer to execute a method adjusting a photographing interval of a camera, the method comprising:

receiving sensor data from one or more sensors, wherein the sensor data corresponds to a behavior of a user who is wearing the wearable terminal device;

determining, based on the behavior of the user, a corresponding rate of change in an environment surrounding the wearable terminal device;

capturing an image by a camera of the wearable terminal device;

identifying a plurality of persons in the captured image;

identifying a predetermined relationship with at least one of the plurality of persons identified in the captured image; and

controlling based on the determined rate of change of the environment and the predetermined relationship, the photographing interval of the camera.

18. The non-transitory computer readable medium of claim 17, the method further comprising:

decreasing the photographing interval based on an increase in the rate of change of the environment surrounding the wearable terminal device.

19. The non-transitory computer readable medium of claim 17, wherein the one or more sensors include at least one geospatial positioning sensor.

20. The non-transitory computer readable medium of claim 19, the method further comprising:

determining the behavior of the user based on the indication of the motion and a location input received from the at least one geospatial positioning sensor; and

decreasing the photographing interval when a change in the location input increases.