Information processing apparatus, information processing method, and medium using an action state of a user

• US 9,432,532 B2
• Filed: 10/22/2014
• Issued: 08/30/2016
• Est. Priority Date: 11/01/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Izumihara, Atsushi, Ikeda, Takuo, Ikeda, Tetsuo, Kimura, Kentaro, Koga, Yasuyuki, Tsukahara, Tsubasa
• Primary Examiner(s): GILES, NICHOLAS G
• Application Number:
  US14/521,007
• Publication Number:
  US 20150124111A1
• Time in Patent Office: 678 Days
• US Class Current: 1/1
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 1/00214 details of transmission
• CPC Class Codes: H04N 1/00392 Other manual input means, e.g. digitisers or writing tablets
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

There is provided an information processing apparatus including an action recognition unit configured to recognize an action state of a user based on a measurement result obtained by a sensor carried by the user, an image processing unit configured to perform a process regarding an amount of information on an image photographed by a photographing unit based on an action state of the user recognized by the action recognition unit during photographing by the photographing unit carried by the user, and a transmission control unit configured to cause the image processed by the image processing unit to be transmitted to an image processing device used to perform image recognition.

Claims

1. An information processing apparatus comprising:

a Central Processing Unit (CPU) configured to;

recognize an action state of a user based on a measurement result obtained by a sensor carried by the user;

perform a process regarding an amount of information on an image photographed by a camera based on the action state of the user recognized during photographing by the camera carried by the user; and

cause the image, after the process, to be transmitted to a server used to perform image recognition,

wherein the image, after the process, is obtained by clipping a predetermined region from the photographed image in an event a state in which the user is watching is recognized, and

wherein the predetermined region is a region within a predetermined distance from a center in the photographed image.

2. The information processing apparatus according to claim 1, wherein the CPU is configured to:

generate an image obtained by reducing an amount of information from the photographed image using a way corresponding to the action state of the user recognized during photographing by the camera, and

cause the image having the reduced amount of information to be transmitted to the server.

3. The information processing apparatus according to claim 1, wherein the CPU is configured to recognize the action state of the user based on a movement of a head of the user measured by the sensor.

4. The information processing apparatus according to claim 3, wherein the CPU is configured to recognize that the user is watching in an event the sensor measures that a speed of movement of the head of the user is reduced to be less than or equal to a predetermined value.

5. The information processing apparatus according to claim 3,

wherein the action state of the user includes a movement state of the user, and

wherein the CPU is configured to generate an image obtained by clipping a predetermined region from the photographed image in an event a state in which the user is moving during photographing by the camera is recognized.

8. The information processing apparatus according to claim 1, wherein the CPU is configured to:

determine whether the photographed image is blurred to be greater than or equal to a threshold, and

prevent the photographed image from being transmitted to the server in an event the CPU determines that the photographed image is blurred to be greater than or equal to the threshold.

9. The information processing apparatus according to claim 1, wherein the CPU is configured to:

determine whether the photographed image is blurred to be greater than or equal to a threshold, and

correct a blur contained in the photographed image based on the action state of the user in an event the CPU determines that the photographed image is blurred to be greater than or equal to the threshold.

6. An information processing apparatus comprising:

a Central Processing Unit (CPU) configured to;

recognize an action state of a user based on a measurement result obtained by a sensor carried by the user;

perform a process regarding an amount of information on an image photographed by a camera based on the action state of the user recognized during photographing by the camera carried by the user;

cause the image, after the process, to be transmitted to a server used to perform image recognition;

recognize the action state of the user based on a movement of a head of the user measured by the sensor;

recognize that the user is looking down using the sensor;

clip a region from the photographed image such that the region to be clipped is within a predetermined distance from a lower end of the photographed image in an event a state in which the user is looking down is recognized; and

cause an image of the region to be transmitted to the server.

7. An information processing apparatus comprising:

a Central Processing Unit (CPU) configured to;

recognize an action state of a user based on a measurement result obtained by a sensor carried by the user;

perform a process regarding an amount of information on an image photographed by a camera based on the action state of the user recognized during photographing by the camera carried by the user;

cause the image, after the process, to be transmitted to an image processing device used to perform image recognition;

recognize the action state of the user based on a movement of a head of the user measured by the sensor;

recognize that the user is looking upward using the sensor; and

clip a region from the photographed image such that the region to be clipped is within a predetermined distance from an upper end of the photographed image in an event a state in which the user is looking upward is recognized; and

cause an image of the region to be transmitted to the server.

10. An information processing method comprising:

recognizing an action state of a user based on a measurement result obtained by a sensor carried by the user;

performing, by a processor, a process regarding an amount of information on an image photographed by a camera based on the action state of the user recognized during photographing by the camera carried by the user; and

causing the image, after the process, to be transmitted to a server used to perform image recognition,

wherein the image, after the process, is obtained by clipping a predetermined region from the photographed image in an event a state in which the user is watching is recognized, and

wherein the predetermined region is a region within a predetermined distance from a center in the photographed image.

11. A non-transitory computer-readable storage medium, having stored thereon, a set of instructions for causing a computer to perform the steps comprising:

recognizing an action state of a user based on a measurement result obtained by a sensor carried by the user;

performing a process regarding an amount of information on an image photographed by a camera based on the action state of the user recognized during photographing by the camera carried by the user; and

causing the image, after the process, to be transmitted to a server used to perform image recognition,

wherein the image, after the process, is obtained by clipping a predetermined region from the photographed image in an event a state in which the user is watching is recognized, and

wherein the predetermined region is a region within a predetermined distance from a center in the photographed image.