Methods and systems for interaction with an expanded information space

• US 9,389,682 B2
• Filed: 07/01/2013
• Issued: 07/12/2016
• Est. Priority Date: 07/02/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Nakayama, Ryuji
• Primary Examiner(s): Tzeng, Fred
• Application Number:
  US13/932,543
• Publication Number:
  US 20140002351A1
• Time in Patent Office: 1,107 Days
• Field of Search: 345/156, 345/158, 345/8
• US Class Current: 1/1
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/525 Changing parameters of virtual cameras
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 2300/695 Imported photos, e.g. of the player
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G09F 19/14 displaying different signs depending upon the view-point of the observer
• CPC Class Codes: G09F 27/00 Combined visual and audible advertising or displaying, e.g. for public address
• CPC Class Codes: G09G 2340/04 Changes in size, position or resolution of an image
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/003 : to produce spatial visual effects
• CPC Class Codes: G09G 5/00 : Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H04N 13/366 : using viewer tracking
• CPC Class Codes: H04N 21/42204 : User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 : Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 : Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/431 : Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/44218 : Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4781 : Games
• CPC Class Codes: H04N 21/4782 : Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4788 : communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/482 : End-user interface for program selection broadcast systems using EPGs H04H60/72

Abstract

A method for presenting content on a display screen is provided. The method initiates with presenting first content on the display screen, the first content being associated with a first detected viewing position of a user that is identified in a region in front of the display screen. At least part of second content is presented on the display screen along with the first content, the second content being progressively displayed along a side of the display screen in proportional response to a movement of the user from the first detected viewing position to a second detected viewing position of the user.

Claims

1. A method for presenting content on a display screen, comprising:

presenting first content on the display screen, the first content being associated with a first detected viewing position of a user that is identified in a region in front of the display screen, the first content being defined by video content;

presenting at least part of second content on the display screen along with the first content, the second content being progressively displayed along an edge of the display screen in proportional response to a movement of the user from the first detected viewing position to a second detected viewing position of the user, wherein the edge of the display screen is substantially opposite a lateral direction relative to the display screen that is defined by the movement of the user from the first detected viewing position to the second detected viewing position;

wherein the at least part of the second content is presented as a blended transition with the first content.

2. The method of claim 1, wherein the proportional response is linear or non-linear.

3. The method of claim 1, wherein the second content is presented as a perspective projection to provide an appearance on the display screen of the second content oriented at an angle relative to the first content.

4. The method of claim 1, wherein in response to a radial movement of the user relative to the display screen, the radial movement defined by the change from the first detected viewing position to the second detected viewing position, a size of the presentation of the first content is adjusted.

5. The method of claim 1, wherein the second content includes one or more of an image, a video, a webpage, a browser, or a game.

6. A method for presenting content on a television display screen, comprising:

assigning first content to a first render space, the first content being defined by a television program;

assigning second content to a second render space;

presenting the first render space on the television display screen while tracking a position of a viewer in front of the display screen;

presenting a transition to the second render space from the first render space in response to changes in viewer position, the first content and the second content remaining in the first and second render spaces during transitioning;

wherein the first render space defines a first planar surface, the presentation of the first render space providing an appearance of the first planar surface being substantially parallel with a plane defined by the display screen; and

wherein the second render space defines a second planar surface, the presentation of the second render space being distorted to provide an appearance of the second planar surface being substantially not parallel with the plane defined by the display screen.

7. The method of claim 6, wherein the transition is defined by a progressive movement of the second render space from off-screen to on-screen.

8. The method of claim 6, wherein the transition is defined by a decrease in display area of the display screen occupied by the presentation of the first render space and a simultaneous increase in display area of the display screen occupied by the presentation of the second render space.

9. The method of claim 6, wherein the second content includes one or more of an image, a video, a webpage, a browser, or a game.

10. The method of claim 6, further comprising:

in response to detecting a gesture of the user during the presentation of the transition, reassigning the first content to the second render space and reassigning the second content to the first render space, and updating the presentation of the first and second render spaces accordingly.

11. A method for presenting content on a display screen, comprising:

assigning first content to a first render space;

assigning second content to a second render space;

presenting the first render space on the display screen while tracking a position of a viewer in front of the display screen;

presenting a transition to the second render space from the first render space in response to changes in viewer position, the first content and the second content remaining in the first and second render spaces during transitioning;

in response to detecting a gesture of the user during the presentation of the transition, reassigning the first content to the second render space and reassigning the second content to the first render space, and updating the presentation of the first and second render spaces accordingly.

12. A method, comprising:

tracking a movement of a user from an first location to a second location in a vicinity of a display;

moving a virtual viewpoint from a first location in a virtual space to a second location in the virtual space based on the tracked movement of the user, the movement of the virtual viewpoint relative to a virtual window in the virtual space being in a same direction as the movement of the user relative to the display;

updating a field of view of the user, from a first field of view corresponding to the first location of the virtual viewpoint, to a second field of view corresponding to the second location of the virtual viewpoint,

wherein the first field of view of the user is defined by a projection of a virtual window, from a vertex defined by the first location of the virtual viewpoint, to a content space in the virtual space, and

wherein the second field of view of the user is defined by a projection of the virtual window, from a vertex defined by the second location of the virtual viewpoint, to the content space in the virtual space;

rendering, on the display, the updating of the field of view from the first field of view to the second field of view;

wherein the content space includes a first content panel and a second content panel;

wherein the first field of view includes an entire portion of the first content panel; and

wherein the second field of view includes a portion of the first content panel and a portion of the second content panel;

detecting a gesture of the user during the rendering of the second field of view;

in response to detecting the gesture, shifting the first and second content panels relative to the virtual space, the shifting of the first and second content panels being in a lateral direction relative to the virtual window, and updating the second field of view in accordance with the shifting of the first and second content panels.

13. The method of claim 12, further comprising,

in response to detecting a second gesture, swapping locations of the first content panel and the second content panel within the content space, and updating the second field of view in accordance with the swapping of the first and second content panels.

14. The method of claim 12, wherein the first content panel and the second content panel are substantially parallel to each other.