Information processing system, information processing terminal, and information processing method

• US 10,546,402 B2
• Filed: 04/16/2015
• Issued: 01/28/2020
• Est. Priority Date: 07/02/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Nakata, Masashi
• Primary Examiner(s): Dang, Philip P.
• Application Number:
  US15/312,268
• Publication Number:
  US 20170161929A1
• Time in Patent Office: 1,748 Days
• CPC Class Codes: G06F 13/00 Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units interface circuits for specific input/output devices G06F3/00 ; multiprogram control therefor G06F9/46; multiprocessor systems G06F15/16
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 1/72439 for image or video messaging
• CPC Class Codes: H04M 11/00 Telephonic communication systems specially adapted for combination with other electrical systems
• CPC Class Codes: H04M 2250/10 including a GPS signal receiver
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/672 based on the phase difference signals
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

[Object] To provide an information processing system capable of transmitting a message with a state of a user at the time of inputting the message, to another user. [Solution] The information processing system includes: a message acquisition unit configured to acquire messages input by users; a related information acquisition unit configured to use an imaging device and acquire information related to the user who has input the message; and a control unit configured to control information processing to transmit the input message on the basis of the information related to the user.

Claims

1. An information processing system, comprising:

a camera; and

at least one processor configured to;

acquire a message input by a user;

adjust a shift length of a focus position of the camera to defocus the camera;

control the defocused camera to capture an image associated with the user, wherein

the captured image is blurred;

acquire positional information of the user by use of a positional sensor;

determine a distance between the user and at least one recipient of the message based on the positional information;

transmit the message based on the blurred image, wherein the transmitted message includes information on the distance between the user and the at least one recipient; and

generate a display in which the blurred image is a background of the transmitted message,

wherein the camera is configured to detect the focus position based on an image surface phase difference detection of the captured image.

2. The information processing system according to claim 1, wherein the at least one processor is further configured to:

automatically capture the image associated with the user based on the input of the message.

3. The information processing system according to claim 1, wherein the at least one processor is further configured to:

determine a state of the user based on the captured image associated with the user.

4. The information processing system according to claim 3, wherein the at least one processor is further configured to:

determine the state of the user based on a word included in the message.

5. The information processing system according to claim 3, wherein the at least one processor is further configured to:

generate a display in which a word corresponding to the state of the user is emphasized, wherein the word is included in the message.

6. The information processing system according to claim 1, wherein the at least one processor is further configured to:

control a display color of the message based on color information of the captured image.

7. The information processing system according to claim 1, wherein the at least one processor is further configured to:

determine a plurality of candidate sites for a gathering place for the user and the at least one recipient based on the positional information; and

generate a display which includes the plurality of candidate sites.

8. The information processing system according to claim 7, wherein the at least one processor is further configured to:

determine a candidate site of the plurality of candidate sites for the gathering place for the user and the at least one recipient based on priority levels of the plurality of candidate sites.

9. The information processing system according to claim 1, wherein, in response to an input from the user, the at least one processor is further configured to change the captured image associated with the user.

10. The information processing system according to claim 1, wherein the at least one processor is further configured to:

acquire information on a characteristic behavior of the user based on the image captured by the defocused camera.

11. The information processing system according to claim 10, wherein the at least one processor is further configured to:

transmit the message by generation of a display in which the captured image is changed based on the information on the characteristic behavior of the user.

12. The information processing system according to claim 10, wherein the at least one processor is further configured to:

determine whether the user uses a function, based on the information on the characteristic behavior of the user.

13. The information processing system according to claim 10, wherein the at least one processor is further configured to:

evaluate a degree of the characteristic behavior of the user;

link a result of the evaluation of the characteristic behavior to a recipient of the message; and

transmit the message based on the result of the evaluation of the characteristic behavior linked to the recipient.

14. The information processing system according to claim 10, wherein the at least one processor is further configured to:

numerically evaluate a degree of the characteristic behavior of the user;

assign a numerical value, obtained by the numerical evaluation, to the recipient of the message; and

determine whether the user uses a function, based on the numerical value satisfies a condition.

15. An information processing terminal, comprising:

a camera; and

at least one processor configured to;

acquire a message input by a user;

adjust a shift length of a focus position of the camera to defocus an imaging device;

control the defocused camera to capture an image associated with the user, wherein

the captured image is blurred;

acquire positional information of the user by use of a positional sensor;

determine a distance between the user and at least one recipient of the message based on the positional information;

transmit the blurred image and the message, wherein the transmitted message includes information on the distance between the user and the at least one recipient; and

generate a display in which the blurred image is a background of the transmitted message,

wherein the camera is configured to detect the focus position based on an image surface phase difference detection of the captured image.

16. An information processing method, comprising:

acquiring a message input by a user;

adjusting a shift length of a focus position of a camera to defocus the camera;

controlling the defocused camera to capture an image associated with the user, wherein

the captured image is blurred;

acquiring positional information of the user by use of a positional sensor;

determining a distance between the user and at least one recipient of the message based on the positional information;

transmitting the message based on the blurred image, wherein the transmitted message includes information on the distance between the user and the at least one recipient; and

generating a display in which the blurred image is a background of the transmitted message,

wherein the camera is configured to detect the focus position based on an image surface phase difference detection of the captured image.