Interaction with an expanded information space on a cellular phone

• US 9,367,126 B2
• Filed: 09/30/2014
• Issued: 06/14/2016
• Est. Priority Date: 07/02/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Nakayama, Ryuji
• Primary Examiner(s): Tzeng, Fred
• Application Number:
  US14/503,284
• Publication Number:
  US 20150015487A1
• Time in Patent Office: 623 Days
• Field of Search: 345/156, 345/158, 345/8, 345/419, 345/633
• US Class Current: 1/1
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/525 Changing parameters of virtual cameras
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 2300/695 Imported photos, e.g. of the player
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G09F 19/14 displaying different signs depending upon the view-point of the observer
• CPC Class Codes: G09F 27/00 Combined visual and audible advertising or displaying, e.g. for public address
• CPC Class Codes: G09G 2340/04 Changes in size, position or resolution of an image
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/003 : to produce spatial visual effects
• CPC Class Codes: G09G 5/00 : Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H04N 13/366 : using viewer tracking
• CPC Class Codes: H04N 21/42204 : User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 : Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 : Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/431 : Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/44218 : Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4781 : Games
• CPC Class Codes: H04N 21/4782 : Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4788 : communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/482 : End-user interface for program selection broadcast systems using EPGs H04H60/72

Abstract

A method for providing a dynamic perspective-based presentation of content on a cellular phone is provided, comprising: presenting a first portion of a content space on a display screen of the cellular phone; tracking a location of a user'"'"'s head in front of the display screen; detecting a lateral movement of the user'"'"'s head relative to the display screen; progressively exposing an adjacent second portion of the content space, from an edge of the display screen opposite a direction of the lateral movement, in proportional response to the lateral movement of the user'"'"'s head relative to the display screen.

Claims

1. A method for providing a dynamic perspective-based presentation of content on a cellular phone, comprising:

presenting a first portion of a content space on a display screen of the cellular phone;

tracking a location of a user'"'"'s head in front of the display screen;

detecting a lateral movement of the user'"'"'s head relative to the display screen;

progressively exposing an adjacent second portion of the content space, from an edge of the display screen opposite a direction of the lateral movement, in proportional response to the lateral movement of the user'"'"'s head relative to the display screen;

rendering audio content associated with the first portion;

as the second portion is progressively exposed, mixing audio content associated with the second portion with the audio content associated with the first portion;

wherein the mixing of the audio content of the first and second portions is in relative proportion to amounts of the display screen that are occupied by the first and second portions of the content space.

2. The method of claim 1,

wherein the presentation of the first portion of the content space is defined by a view from a first perspective of the user, the first perspective defined by a first position of the user'"'"'s head relative to the display;

wherein exposing the adjacent second portion of the content space is defined by a view from a second perspective of the user, the second perspective defined by a second position of the user'"'"'s head relative to the display.

3. The method of claim 1, wherein tracking the location of the user'"'"'s head includes identifying and tracking a face of the user.

4. The method of claim 1, wherein tracking the location of the user'"'"'s head includes capturing images of the user'"'"'s head and analyzing the captured images to determine the location of the user'"'"'s head.

5. The method of claim 1, wherein the content space defines a store for purchasing digital content.

6. The method of claim 1, further comprising:

when the adjacent second portion of the content space is exposed for viewing, detecting a gesture by the user;

in response to the detected gesture, shifting the second portion to a position of the content space occupied by the first portion.

7. The method of claim 6, wherein the adjacent second portion includes video content, and wherein playback of the video content is configured to initiate upon the shifting of the second portion to the position of the content space occupied by the first portion.

8. The method of claim 1, further comprising:

when the adjacent second portion of the content space is exposed for viewing, detecting a gesture by the user;

in response to the detected gesture, swapping positions of the first portion and the second portion in the content space.

9. The method of claim 1,

wherein as the second portion is progressively exposed, the amount of the display screen occupied by the first portion is reduced and the amount of the display screen occupied by the second portion is increased, and the audio content of the first portion is reduced from 100% to a first transitional amount greater than 0% and the audio content of the second portion is increased from 0% to a second transitional amount less than 100%;

wherein when the second portion is shifted to the position of the content space occupied by the first portion, then the audio content of the first portion is reduced from the first transitional amount to 0% and the audio content of the second portion is increased from the second transitional amount to 100%.

10. The method of claim 9, wherein prior to initiating playback of the video content, the second portion is defined by a representative image frame from the video content.

11. A method for providing a dynamic perspective-based presentation of content on a cellular phone, comprising:

presenting a first portion of a content space on a display screen of the cellular phone;

rendering audio content associated with the first portion;

tracking a location of a user'"'"'s head in front of the display screen;

detecting a radial movement of the user'"'"'s head toward the display screen;

progressively exposing adjacent portions of the content space, from edges of the display screen, in proportional response to the radial movement of the user'"'"'s head toward the display screen;

as the adjacent portions are progressively exposed, mixing audio content associated with the adjacent portions with the audio content associated with the first portion.

12. The method of claim 11,

wherein the presentation of the first portion of the content space is defined by a view from a first perspective of the user, the first perspective defined by a first position of the user'"'"'s head relative to the display;

wherein exposing the adjacent portions of the content space is defined by a view from a second perspective of the user, the second perspective defined by a second position of the user'"'"'s head relative to the display.

13. The method of claim 11, wherein tracking the location of the user'"'"'s head includes identifying and tracking a face of the user.

14. The method of claim 11, wherein tracking the location of the user'"'"'s head includes capturing images of the user'"'"'s head and analyzing the captured images to determine the location of the user'"'"'s head.

15. The method of claim 11, wherein the content space defines a store for purchasing digital content.

16. The method of claim 11, wherein the mixing of the audio content of the first portion and the adjacent portions is in relative proportion to amounts of the display screen that are occupied by the first portion and the adjacent portions of the content space.

17. A portable device configured to provide a dynamic presentation of content, comprising:

a display screen;

logic for view control configured to present a view of a first portion of a content space on the display screen, the processor for view control being further configured to detect a gesture by a user while the first portion is being presented, and in response to the detected gesture, shift the view from the first portion of the content space to an the adjacent second portion of the content space, wherein the adjacent second portion includes video content, and wherein playback of the video content is configured to initiate upon the shifting of the view to the adjacent second portion of the content space.

18. The portable device of claim 17, wherein prior to initiating playback of the video content, the second portion is defined by a representative image frame from the video content.

19. The portable device of claim 17, wherein the gesture is defined by a swipe on the display screen.

20. The portable device of claim 17, wherein shifting the view is defined to progressively expose the second portion of the content space from an edge of the display screen, so that an amount of the display screen occupied by the first portion is progressively reduced as an amount of the display screen occupied by the second portion is progressively increased.

21. The portable device of claim 17, wherein the playback of the video content does not initiate until the second portion of the content space is primarily rendered on the display screen.