INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND MEDIUM USING AN ACTION STATE OF A USER

• US 20160353014A1
• Filed: 08/12/2016
• Published: 12/01/2016
• Est. Priority Date: 11/01/2013
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: IKEDA, TETSUO, IZUMIHARA, ATSUSHI, IKEDA, TAKUO, KIMURA, KENTARO, KOGA, YASUYUKI, TSUKAHARA, TSUBASA
• Application Number:
  US15/235,703
• Publication Number:
  US 20160353014A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 1/00214 details of transmission
• CPC Class Codes: H04N 1/00392 Other manual input means, e.g. digitisers or writing tablets
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

There is provided an information processing apparatus including an action recognition unit configured to recognize an action state of a user based on a measurement result obtained by a sensor carried by the user, an image processing unit configured to perform a process regarding an amount of information on an image photographed by a photographing unit based on an action state of the user recognized by the action recognition unit during photographing by the photographing unit carried by the user, and a transmission control unit configured to cause the image processed by the image processing unit to be transmitted to an image processing device used to perform image recognition.

Claims

1. An information processing device, comprising

at least one CPU configured to:

determine, based on motion information sent from a motion sensor, an action state of a user while a camera carried by the user is activated, wherein the action state includes a movement state and a non-movement state, and a movement amount in the movement state is larger than that in the non-movement state;

in response to determining the movement state, control the camera to capture an image at a first capturing frequency; and

in response to determining the non-movement state, control the camera to capture an image at a second capturing frequency less than the first capturing frequency.

2. The information processing device according to claim 1, wherein the at least one CPU is configured to make power consumption of the non-movement state less than that of the movement state based on control of the camera to capture the image at the second capturing frequency.

3. The information processing device according to claim 1, wherein

the at least one CPU is configured to:

control the camera to clip a region from the captured image in an event the action state is a state in which the user is watching; and

cause the clipped region to be transmitted to an image recognition unit configured to recognize the image,

wherein the region is within a determined distance from a center in the captured image.

4. The information processing device according to claim 3, wherein the clipped region has information amount less than that of the captured image.

5. The information processing device according to claim 4, wherein the at least one CPU is configured to determine the action state of the user based on a movement of a head of the user detected by the motion sensor.

6. The information processing device according to claim 5, wherein

the motion sensor is configured to detect a speed of movement of the head of the user, and

the at least one CPU is configured to determine that the user is watching in an event that the detected speed is reduced to be less than or equal to a threshold value.

7. The information processing device according to claim 1, wherein

the motion sensor is configured to obtain acceleration information, and

the at least one CPU is configured to control the camera to change the second capturing frequency to the first capturing frequency in accordance with the acceleration information.

8. The information processing device according to claim 7, wherein the at least one CPU is configured to control the camera to capture an image at the first capturing frequency in an event the action state is a walking state.

9. The information processing device according to claim 1, wherein the at least one CPU is configured to reduce an information amount of the captured image in an event the user is in the movement state, and transmit the captured image that has the reduced information amount to an image recognition unit configured for image recognition.

10. The information processing device according to claim 9, wherein the information amount is a resolution of the captured image.

11. The information processing device according to claim 9, wherein the at least one CPU is configured to:

clip a region that corresponds to a facing direction of the user, and

transmit the clipped region to an image recognition unit configured for image recognition.

12. The information processing device according to claim 11, wherein the facing direction is associated with a state where the user looks around, downward, or upward.

13. The information processing device according to claim 1, wherein the at least one CPU is configured to prevent an image, which has a blurring level greater than or equal to a threshold, from being transmitted to an image recognition unit configured for image recognition.

14. An information processing method, comprising:

determining, based on motion information sent from a motion sensor, an action state of a user while a camera carried by the user is activated, wherein the action state includes a movement state and a non-movement state, and a movement amount in the movement state is larger than that in the non-movement state;

in response to determining the movement state, controlling the camera to capture an image at a first capturing frequency; and

in response to determining the non-movement state, controlling the camera to capture an image at a second capturing frequency less than the first capturing frequency.

15. A non-transitory computer-readable storage medium, having stored thereon, a set of instructions for causing a computer to perform operations, comprising:

determining, based on motion information sent from a motion sensor, an action state of a user while a camera carried by the user is activated, wherein the action state includes a movement state and a non-movement state, and a movement amount in the movement state is larger than that in the non-movement state;

in response to determining the movement state, controlling the camera to capture an image at a first capturing frequency; and

in response to determining the non-movement state, controlling the camera to capture an image at a second capturing frequency less than the first capturing frequency.