INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM

• US 20150124111A1
• Filed: 10/22/2014
• Published: 05/07/2015
• Est. Priority Date: 11/01/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: IZUMIHARA, Atsushi, IKEDA, Takuo, IKEDA, Tetsuo, KIMURA, Kentaro, KOGA, Yasuyuki, TSUKAHARA, Tsubasa
• Granted Patent: US 9,432,532 B2
• Time in Patent Office: Days
• US Class Current: 348/211.99
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 1/00214 details of transmission
• CPC Class Codes: H04N 1/00392 Other manual input means, e.g. digitisers or writing tablets
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

There is provided an information processing apparatus including an action recognition unit configured to recognize an action state of a user based on a measurement result obtained by a sensor carried by the user, an image processing unit configured to perform a process regarding an amount of information on an image photographed by a photographing unit based on an action state of the user recognized by the action recognition unit during photographing by the photographing unit carried by the user, and a transmission control unit configured to cause the image processed by the image processing unit to be transmitted to an image processing device used to perform image recognition.

Claims

1. An information processing apparatus comprising:

an action recognition unit configured to recognize an action state of a user based on a measurement result obtained by a sensor carried by the user;

an image processing unit configured to perform a process regarding an amount of information on an image photographed by a photographing unit based on an action state of the user recognized by the action recognition unit during photographing by the photographing unit carried by the user; and

a transmission control unit configured to cause the image processed by the image processing unit to be transmitted to an image processing device used to perform image recognition.

2. The information processing apparatus according to claim 1,

wherein the image processing unit generates an image obtained by reducing an amount of information from the photographed image using a way corresponding to an action state of the user recognized by the action recognition unit during photographing by the photographing unit, and

wherein the transmission control unit causes the image having the reduced amount of information to be transmitted to the image processing device.

3. The information processing apparatus according to claim 1, wherein the action recognition unit recognizes an action state of the user based on a movement of a head of the user measured by the sensor.

4. The information processing apparatus according to claim 3,

wherein the action state of the user includes a vision-related state of the user,

wherein the action recognition unit recognizes that the user is looking around when the sensor measures that a movement of the user'"'"'s head is within a predetermined range, and

wherein the image processing unit generates an image obtained by reducing resolution from the photographed image when a state in which the user is looking around is recognized.

5. The information processing apparatus according to claim 3,

wherein the action recognition unit recognizes that the user is watching when the sensor measures that a speed of movement of the head of the user is reduced to be less than or equal to a predetermined value, and

wherein the image processing unit generates an image obtained by clipping a predetermined region from the photographed image when a state in which the user is watching is recognized.

6. The information processing apparatus according to claim 3,

wherein the action state of the user includes a movement state of the user, and

wherein the image processing unit generates an image obtained by clipping a predetermined region from the photographed image when a state in which the user is moving during photographing by the photographing unit is recognized.

7. The information processing apparatus according to claim 5, wherein the predetermined region is a peripheral region at a predetermined distance or more away from a center in the photographed image.

8. The information processing apparatus according to claim 5, wherein the predetermined region is a region within a predetermined distance from a center in the photographed image.

9. The information processing apparatus according to claim 1, further comprising:

a face region detection unit configured to detect a face region of a person contained in the photographed image,

wherein the image processing unit clips a face region detected by the face region detection unit from the photographed image, and

wherein the transmission control unit causes an image of the face region clipped by the image processing unit to be transmitted to the image processing device.

10. The information processing apparatus according to claim 3,

wherein the action recognition unit recognizes that the user is looking down using the sensor,

wherein the image processing unit clips a region from the photographed image such that the region to be clipped is within a predetermined distance from a lower end of the photographed image when a state in which the user is looking down is recognized, and

wherein the transmission unit causes an image of the region clipped by the image processing unit to be transmitted to the image processing device.

11. The information processing apparatus according to claim 3,

wherein the action recognition unit recognizes that the user is looking upward using the sensor,

wherein the image processing unit clips a region from the photographed image such that the region to be clipped is within a predetermined distance from an upper end of the photographed image when a state in which the user is looking upward is recognized, and

wherein the transmission unit causes an image of the region clipped by the image processing unit to be transmitted to the image processing device.

12. The information processing apparatus according to claim 1, further comprising:

a blur determination unit configured to determine whether the photographed image is blurred to be greater than or equal to a threshold,

wherein the transmission control unit prevents the photographed image from being transmitted to the image processing device when the blur determination unit determines that the photographed image is blurred to be greater than or equal to the threshold.

13. The information processing apparatus according to claim 1, further comprising:

a blur determination unit configured to determine whether the photographed image is blurred to be greater than or equal to a threshold,

wherein the image processing unit corrects a blur contained in the photographed image based on an action state of the user recognized by the action recognition unit when the blur determination unit determines that the photographed image is blurred to be greater than or equal to the threshold.

14. An information processing method comprising:

recognizing an action state of a user based on a measurement result obtained by a sensor carried by the user;

performing, by a processor, a process regarding an amount of information on an image photographed by a photographing unit based on an action state of the user recognized during photographing by the photographing unit carried by the user; and

causing the processed image to be transmitted to an image processing device used to perform image recognition.

15. A program for causing a computer to function as:

an action recognition unit configured to recognize an action state of a user based on a measurement result obtained by a sensor carried by the user;

an image processing unit configured to perform a process regarding an amount of information on an image photographed by a photographing unit based on an action state of the user recognized by the action recognition unit during photographing by the photographing unit carried by the user; and

a transmission control unit configured to cause the image processed by the image processing unit to be transmitted to an image processing device used to perform image recognition.