Changing a depiction in a captured image based on a state of a subject present in the captured image

• US 9,836,644 B2
• Filed: 02/12/2013
• Issued: 12/05/2017
• Est. Priority Date: 03/27/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Mori, Maki, Kasahara, Shunichi, Shigeta, Osamu, Suzuki, Seiji, Fukazawa, Ryo
• Primary Examiner(s): Koziol, Stephen R
• Assistant Examiner(s): PATEL, PINALBEN V
• Application Number:
  US14/386,434
• Publication Number:
  US 20150049909A1
• Time in Patent Office: 1,757 Days
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet

Abstract

Provided an information processing device including ail image acquisition configured to acquire a captured image, a change detection unit configured to detect a change in a state of a subject in a network service recognized from the captured image, and a depiction change unit configured to change a depiction of the subject shown in the captured image in a case where the change detection unit detects the change in the state.

Claims

1. An information processing device, comprising:

one or more processors configured to;

acquire a captured image;

detect a change in a state of a first subject recognized from the captured image,

specify the first subject as a first user of a portable terminal based on a comparison between a sensor data associated with a movement of the first user as a first parameter and a second parameter associated with the change in the state of the first subject detected from the captured image; and

change a depiction of the first user in the captured image based on a determination of the change in the state of the recognized first subject.

2. The information processing device according to claim 1, wherein the one or more processors are further configured to:

change, based on a determination that the first user is specified from the first subject in the captured image, the depiction of the first user based on an emphasis of the first user in the captured image.

3. The information processing device according to claim 2, wherein the one or more processors are further configured to control display of a display image on the portable terminal, wherein the display image is obtained by the change in the depiction.

4. The information processing device according to claim 1, wherein, based on a determination that the portable terminal of the first subject logs into a network service, the one or more processors are further configured to change the depiction of the first subject in the captured image.

5. The information processing device according to claim 1, wherein, based on a determination that a movement of the portable terminal of the first subject in a network service satisfies a determined condition, the one or more processors are further configured to change the depiction of the first subject in the captured image.

6. The information processing device according to claim 2, wherein the one or more processors are further configured to change a degree of the emphasis of the first user in the captured image based on a size of the first user in the captured image.

7. The information processing device according to claim 6, wherein the one or more processors are further configured to increase the degree of the emphasis of the first user in the captured image based on a decrease in the size of the first user in the captured image.

8. The information processing device according to claim 2, wherein, based on a determination that a portion of the first user or an entirety of the first user is hidden or shown by an object in the captured image, the one or more processors are further configured to change a technique of the emphasis of the first user in the captured image.

9. The information processing device according to claim 2, wherein the one or more processors are further configured to decrease a definition of a second user in the captured image to emphasize the first user, wherein the second user is different from the first user.

10. The information processing device according to claim 2, wherein the one or more processors are further configured emphasize an outline of the first user in the captured image to emphasize the first user.

11. The information processing device according to claim 2, wherein the one or more processors are further configured to emphasize the first user based on a change in a pixel value of a second subject, wherein the second subject is different from the first user in the captured image.

12. The information processing device according to claim 2, wherein the one or more processors are further configured to emphasize the first user based on a zoom operation in display of the first user in the captured image.

13. The information processing device according to claim 2, wherein the one or more processors are further configured to add an object at a first position of the first user or at a second position in a determined distance from the first user in the captured image to emphasize the first user.

16. The information processing device according to claim 1, wherein the one or more processors are further configured to change a thickness of an outline of the first user in the captured image to change the depiction of the first user.

17. The information processing device according to claim 1, wherein the first parameter associated with the first user further comprises a face image of the first user.

18. The information processing device according to claim 1, wherein the second parameter associated with the change in the state of the first subject detected from the captured image further comprises at least one of a facial region of the first subject in the captured image or a movement of the first subject detected from the captured image.

14. An information processing method, comprising:

acquiring a captured image;

detecting a change in a state of a subject recognized from the captured image,

specifying the subject as a user of a portable terminal based on a comparison between a sensor data associated with a movement of the user as a first parameter and a second parameter associated with the change in the state of the subject detected from the captured image; and

changing a depiction of the user in the captured image based on a determination that the change in the state of the recognized subject is detected.

15. A non-transitory computer-readable medium, having stored thereon, computer-executable instructions that causes a computer to execute operations, the operations comprising:

acquiring a captured image;

detecting a change in a state of a subject recognized from the captured image,

specifying the subject as a user of a portable terminal based on a comparison between a sensor data associated with a movement of the user as a first parameter and a second parameter associated with the change in the state of the subject detected from the captured image; and

changing a depiction of the user in the captured image based on a determination that the change in the state of the recognized subject is detected.