INTERACTION WITH AN EXPANDED INFORMATION SPACE ON A CELLULAR PHONE

• US 20150015487A1
• Filed: 09/30/2014
• Published: 01/15/2015
• Est. Priority Date: 07/02/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Nakayama, Ryuji
• Granted Patent: US 9,367,126 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/525 Changing parameters of virtual cameras
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 2300/695 Imported photos, e.g. of the player
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G09F 19/14 displaying different signs depending upon the view-point of the observer
• CPC Class Codes: G09F 27/00 Combined visual and audible advertising or displaying, e.g. for public address
• CPC Class Codes: G09G 2340/04 Changes in size, position or resolution of an image
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/003 : to produce spatial visual effects
• CPC Class Codes: G09G 5/00 : Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H04N 13/366 : using viewer tracking
• CPC Class Codes: H04N 21/42204 : User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 : Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 : Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/431 : Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/44218 : Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4781 : Games
• CPC Class Codes: H04N 21/4782 : Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4788 : communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/482 : End-user interface for program selection broadcast systems using EPGs H04H60/72

Abstract

A method for providing a dynamic perspective-based presentation of content on a cellular phone is provided, comprising: presenting a first portion of a content space on a display screen of the cellular phone; tracking a location of a user'"'"'s head in front of the display screen; detecting a lateral movement of the user'"'"'s head relative to the display screen; progressively exposing an adjacent second portion of the content space, from an edge of the display screen opposite a direction of the lateral movement, in proportional response to the lateral movement of the user'"'"'s head relative to the display screen.

Claims

1. A method for providing a dynamic perspective-based presentation of content on a cellular phone, comprising:

presenting a first portion of a content space on a display screen of the cellular phone;

tracking a location of a user'"'"'s head in front of the display screen;

detecting a lateral movement of the user'"'"'s head relative to the display screen;

progressively exposing an adjacent second portion of the content space, from an edge of the display screen opposite a direction of the lateral movement, in proportional response to the lateral movement of the user'"'"'s head relative to the display screen.

2. The method of claim 1,

wherein the presentation of the first portion of the content space is defined by a view from a first perspective of the user, the first perspective defined by a first position of the user'"'"'s head relative to the display;

wherein exposing the adjacent second portion of the content space is defined by a view from a second perspective of the user, the second perspective defined by a second position of the user'"'"'s head relative to the display.

3. The method of claim 1, wherein tracking the location of the user'"'"'s head includes identifying and tracking a face of the user.

4. The method of claim 1, wherein tracking the location of the user'"'"'s head includes capturing images of the user'"'"'s head and analyzing the captured images to determine the location of the user'"'"'s head.

5. The method of claim 1, wherein the content space defines a store for purchasing digital content.

6. The method of claim 1, further comprising:

when the adjacent second portion of the content space is exposed for viewing, detecting a gesture by the user;

in response to the detected gesture, shifting the second portion to a position of the content space occupied by the first portion.

7. The method of claim 1, further comprising:

when the adjacent second portion of the content space is exposed for viewing, detecting a gesture by the user;

in response to the detected gesture, swapping positions of the first portion and the second portion in the content space.

8. The method of claim 1, further comprising:

rendering audio content associated with the first portion;

as the second portion is progressively exposed, mixing audio content associated with the second portion with the audio content associated with the first portion.

9. The method of claim 8, wherein the mixing of the audio content of the first and second portions is in relative proportion to amounts of the display screen that are occupied by the first and second portions of the content space.

23. The method of claim 1, further comprising:

rendering audio content associated with the first portion;

as the adjacent portions are progressively exposed, mixing audio content associated with the adjacent portions with the audio content associated with the first portion.

24. The method of claim 23, wherein the mixing of the audio content of the first portion and the adjacent portions is in relative proportion to amounts of the display screen that are occupied by the first portion and the adjacent portions of the content space.

10. A cellular phone configured to provide a dynamic perspective-based presentation of content, comprising:

a display screen;

an image capture device configured to capture images of a user'"'"'s head;

logic for image processing configured to analyze the captured images to determine and track a location of the user'"'"'s head;

a processor for view control configured to present a first portion of a content space on the display screen, the processor for view control being further configured to progressively expose an adjacent second portion of the content space, from an edge of the display screen opposite a direction of the lateral movement, in proportional response to a detected lateral movement of the user'"'"'s head relative to the display screen.

11. The cellular phone of claim 10,

wherein the presentation of the first portion of the content space is defined by a view from a first perspective of the user, the first perspective defined by a first position of the user'"'"'s head relative to the display;

wherein exposing the adjacent second portion of the content space is defined by a view from a second perspective of the user, the second perspective defined by a second position of the user'"'"'s head relative to the display.

12. The cellular phone of claim 10, wherein determining and tracking the location of the user'"'"'s head includes identifying and tracking a face of the user.

13. The cellular phone of claim 10, wherein the content space defines a store for purchasing digital content.

14. The cellular phone of claim 10, wherein the processor for view control is further configured to detect a gesture by the user when the adjacent second portion of the content space is exposed for viewing, and, in response to the detected gesture, shift the second portion to a position of the content space occupied by the first portion.

15. The cellular phone of claim 10, wherein the processor for view control is further configured to detect a gesture by the user when the adjacent second portion of the content space is exposed for viewing, and, in response to the detected gesture, swap positions of the first portion and the second portion in the content space.

16. The cellular phone of claim 10, further comprising:

a speaker;

an processor for audio mixing configured to, as the second portion is progressively exposed, mix audio content associated with the second portion with audio content associated with the first portion, for output via the speaker.

17. The cellular phone of claim 16, wherein the mixing of the audio content of the first and second portions is in relative proportion to amounts of the display screen that are occupied by the first and second portions of the content space.

18. A method for providing a dynamic perspective-based presentation of content on a cellular phone, comprising:

presenting a first portion of a content space on a display screen of the cellular phone;

tracking a location of a user'"'"'s head in front of the display screen;

detecting a radial movement of the user'"'"'s head toward the display screen;

progressively exposing adjacent portions of the content space, from edges of the display screen, in proportional response to the radial movement of the user'"'"'s head toward the display screen.

19. The method of claim 18,

wherein the presentation of the first portion of the content space is defined by a view from a first perspective of the user, the first perspective defined by a first position of the user'"'"'s head relative to the display;

wherein exposing the adjacent portions of the content space is defined by a view from a second perspective of the user, the second perspective defined by a second position of the user'"'"'s head relative to the display.

20. The method of claim 18, wherein tracking the location of the user'"'"'s head includes identifying and tracking a face of the user.

21. The method of claim 18, wherein tracking the location of the user'"'"'s head includes capturing images of the user'"'"'s head and analyzing the captured images to determine the location of the user'"'"'s head.

22. The method of claim 18, wherein the content space defines a store for purchasing digital content.