Information processing system, information processing method and program

• US 10,423,283 B2
• Filed: 02/23/2016
• Issued: 09/24/2019
• Est. Priority Date: 03/31/2015
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ikeda, Tetsuo, Saito, Hiroshi, Kamachi, Maya, Hayashi, Yu
• Primary Examiner(s): Simpson, Lixi C
• Application Number:
  US15/541,576
• Publication Number:
  US 20170351383A1
• Time in Patent Office: 1,309 Days
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

There is provided an information processing apparatus including circuitry configured to control output of a first content according to first content information, determine information related to a real object which is different from a manipulation body used for content selection or object manipulation by a user, and control output of a second content, which is different from the first content, according to second content information, wherein the second content information is based on the first content information and the determined information related to the real object.

Claims

1. An information processing apparatus, comprising:

circuitry configured to

control output of a first display object according to first content information,

determine information related to a real object which is different from a manipulation body used for content selection or object manipulation by a user, and

control output of a second display object, which is different from the first display object, according to second content information,

wherein the circuitry controls the output of at least one of the first display object or the second display object based on registered correspondence relation information indicating a degree of association between the first or second content information and the determined information related to the real object, and

wherein the circuitry controls a transparency of the output of the second display object based on the registered correspondence relation information, and upon a determination by the user to activate a semitransparent display object suggestion for the second display object, the second display object is output with full functional and display information.

2. The information processing apparatus according to claim 1, wherein the first content information comprises a first display location of the first display object on a display surface.

3. The information processing apparatus according to claim 2, wherein the second content information comprises a second display location of the second display object on the display surface.

4. The information processing apparatus according to claim 3, wherein the circuitry initiates display of the second display object when the information related to the real object indicates a spatial relationship between the real object and one or more components of the circuitry.

5. The information processing apparatus according to claim 4, wherein the spatial relationship with one or more components of the circuitry comprises a state in which the real object is worn or held by the user within a predetermined distance from one or more components of the circuitry.

6. The information processing apparatus according to claim 4, wherein the spatial relationship with one or more components of the circuitry comprises a state of being within a threshold distance from the display surface.

7. The information processing apparatus according to claim 4, wherein the spatial relationship with one or more components of the circuitry comprises a state of being in contact with the display surface.

8. The information processing apparatus according to claim 3, wherein the information related to the real object is based on a captured image of the real object.

9. The information processing apparatus according to claim 8, wherein the captured image of the real object indicates a location of the real object with respect to the display surface.

10. The information processing apparatus according to claim 9, wherein the circuitry initiates display of the second display object when the location of the real object is within a threshold distance from the display surface.

11. The information processing apparatus according to claim 3, wherein upon the determination by the user, the second display object and second display location are registered in association with a combination of the first content information and the determined information related to the real object, such that the second display object is output at the determined second display location with full functional and display information when the combination of the first content information and the determined information related to the real object is detected.

12. The information processing apparatus according to claim 1, wherein the first content information comprises identification information of the first display object.

13. The information processing apparatus according to claim 1, wherein the information related to the real object is based on a captured image of the real object.

14. The information processing apparatus according to claim 13, wherein the captured image of the real object indicates a location of the real object with respect to one or more components of the circuitry.

15. The information processing apparatus according to claim 13, wherein the captured image of the real object indicates a shape of the real object.

16. The information processing apparatus according to claim 1, wherein the second content information is further based on at least one of information of time or information of a user profile.

17. The information processing apparatus according to claim 1, wherein the second content information is further based on a user'"'"'s biometric information.

18. The information processing apparatus according to claim 1, wherein the registered correspondence relation information is determined using at least one of

a local correspondence database based on one or more prior associations between the first content information and the determined information related to the real object by the user, or

a cloud correspondence database based on more prior associations between the first content information and the determined information related to the real object by another user.

19. The information processing apparatus according to claim 1,

wherein when the registered correspondence relation information indicates that the degree of association between the second content information and the determined information related to the real object is less than a threshold degree, the circuitry controls the output of the second display object to be the semitransparent display object suggestion for activation by the user, and

wherein when the registered correspondence relation information indicates that the degree of association between the first content information and the determined information related to the real object is greater than or equal to the threshold degree, the circuitry controls the output of the second display object to be automatically activated with full functional and display information.

20. An information processing method comprising:

outputting a first display object according to first content information;

determining information related to a real object which is different from a manipulation body used for content selection or object manipulation by a user; and

outputting a second display object, which is different from the first display object, according to second content information,

wherein the outputting of at least one of the first display object or the second display object is based on registered correspondence relation information indicating a degree of association between the first or second content information and the determined information related to the real object, and

wherein a transparency of the second display object is controlled based on the registered correspondence relation information, and upon a determination by the user to activate a semitransparent display object suggestion for the second display object, the second display object is output with full functional and display information.

21. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

outputting a first display object according to first content information;

determining information related to a real object which is different from a manipulation body used for content selection or object manipulation by a user; and

outputting a second display object, which is different from the first display object, according to second content information,

wherein the outputting of at least one of the first display object or the second display object is based on registered correspondence relation information indicating a degree of association between the first or second content information and the determined information related to the real object, and

wherein a transparency of the second display object is controlled based on the registered correspondence relation information, and upon a determination by the user to activate a semitransparent display object suggestion for the second display object, the second display object is output with full functional and display information.