System and method to display content based on viewing orientation

• US 9,285,883 B2
• Filed: 03/01/2011
• Issued: 03/15/2016
• Est. Priority Date: 03/01/2011
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Bi, Ning, Aleksic, Milivoje
• Primary Examiner(s): Amadiz, Rodney
• Application Number:
  US13/038,166
• Publication Number:
  US 20120223884A1
• Time in Patent Office: 1,841 Days
• Field of Search: 345156-158
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

An apparatus and method for displaying content is disclosed. A particular method includes determining a viewing orientation of a user relative to a display and providing a portion of content to the display based on the viewing orientation. The portion includes at least a first viewable element of the content and does not include at least one second viewable element of the content. The method also includes determining an updated viewing orientation of the user and updating the portion of the content based on the updated viewing orientation. The updated portion includes at least the second viewable element. A display difference between the portion and the updated portion is non-linearly related to an orientation difference between the viewing orientation and the updated viewing orientation.

Claims

1. A method comprising:

receiving displayable content at a device having a display, the displayable content including a plurality of viewable elements;

determining a first portion of the displayable content based on a viewing orientation of a user relative to the display, wherein the first portion includes at least a first viewable element of the plurality of viewable elements and does not include at least one second viewable element of the plurality of viewable elements;

displaying the first portion of the displayable content at the display;

detecting an updated viewing orientation of the user relative to the display;

determining a second portion of the displayable content based on the updated viewing orientation, wherein the second portion includes at least the second viewable element, wherein a display difference between the first portion and the second portion is non-linearly related to an orientation difference between the viewing orientation and the updated viewing orientation, wherein the second viewable element includes a plurality of independent display windows, and wherein a first independent display window of the plurality of independent display windows is a user interface display of a first application operating at the device, and a second independent display window of the plurality of independent display windows is a user interface display of a second application operating at the device; and

displaying the second portion of the displayable content at the display.

2. The method of claim 1, wherein determining the second portion comprises selecting, with a non-linear relation to the orientation difference, a number of the plurality of independent display windows to be included in the second portion.

3. The method of claim 2, wherein the orientation difference is determined based on a measured movement of the display.

4. The method of claim 2, wherein the orientation difference is determined based on a measured change in a viewing angle of the user relative to the display.

5. The method of claim 4, wherein the change in the viewing angle is measured using a camera associated with the display.

6. The method of claim 1, wherein the first portion comprises a first plurality of viewable elements and the second portion comprises a second plurality of viewable elements, and wherein the display difference corresponds to a number of viewable elements that are distinct between the first plurality of viewable elements and the second plurality of viewable elements.

7. The method of claim 1, wherein detecting the updated viewing orientation includes at least one of detecting a location of an eye of the user and detecting a location of at least a portion of a user'"'"'s face.

8. The method of claim 1, wherein the orientation difference corresponds to a change in a viewer-device relative geometry location.

9. The method of claim 1, wherein the updated viewing orientation is detected based at least in part on a detected gesture of the user.

10. The method of claim 1, wherein orientation difference is determined based at least in part on a measured movement of the device.

11. The method of claim 1, wherein the first independent display window of the plurality of independent display windows is a user interface display of a first instance of the first application, and a third independent display window of the plurality of independent display windows is a user interface display of a second instance of the first application.

12. The method of claim 1, further comprising:

determining a cylindrical representation of the displayable content based on a display size of the display, wherein the cylindrical representation includes a single curved face, wherein the first portion and the second portion correspond to portions of the cylindrical representation, and the display difference corresponds to an amount of rotation of the cylindrical representation about an axis.

13. The method of claim 12, wherein the orientation difference corresponds to an amount of rotation of the device, and wherein the amount of rotation of the device is non-linearly related to the amount of rotation of the cylindrical representation about the axis.

14. The method of claim 13, wherein a rate of the rotation of the cylindrical representation is determined based on the orientation difference.

15. The method of claim 1, wherein displaying the first portion of the displayable content comprises displaying the first portion of the displayable content at a first time, and wherein displaying the second portion of the displayable content comprises displaying the second portion of the displayable content at a second time that is subsequent to the first time, such that the first portion and the second portion are not displayed at the same time.

16. A device comprising:

one or more processors; and

a memory coupled to the one or more processors, the memory storing displayable content that includes a plurality of viewable elements, the memory further storing instructions that are executable by the one or more processors to;

operate a first application;

operate a second application;

determine a viewing orientation of a user relative to a display;

provide a first portion of the content to the display based on the viewing orientation, wherein the first portion includes at least a first viewable element of the content and does not include at least one second viewable element of the content;

determine an updated viewing orientation of the user; and

provide an updated portion of the content to the display based on the updated viewing orientation, wherein the updated portion includes at least the second viewable element, wherein a display difference between the first portion and the updated portion is non-linearly related to an orientation difference between the viewing orientation and the updated viewing orientation, wherein the second viewable element includes a plurality of independent display windows, and wherein a first independent display window of the plurality of independent display windows is a user interface display of the first application, and a second independent display window of the plurality of independent display windows is a user interface display of the second application.

17. The device of claim 16, wherein the display is integral to the apparatus.

18. The device of claim 17, further comprising a camera coupled to the processor.

19. The device of claim 18, wherein the instructions are further executable by the one or more processors to determine a viewing orientation of the user relative to the display based on one or more images captured by the camera.

20. The device of claim 16, wherein the first independent display window of the plurality of independent display windows is a user interface display of a first instance of the first application, and a third independent display window of the plurality of independent display windows is a user interface display of a second instance of the first application.

21. The device of claim 16, wherein the memory further includes instructions that are executable by the one or more processors to:

determine a cylindrical representation of the displayable content based on a display size of the display, wherein the cylindrical representation includes a single curved face, wherein the first portion and the updated portion correspond to portions of the cylindrical representation, and the display difference corresponds to an amount of rotation of the cylindrical representation about an axis.

22. The apparatus of claim 16, wherein the instructions that are executable by the processor to display the first portion of the content comprise instructions that are executable by the processor to display the first portion of the displayable content at a first time, and wherein the instructions that are executable by the processor to display the second portion of the displayable content comprise instructions that are executable by the processor to display the second portion of the displayable content at a second time that is subsequent to the first time, such that the first portion and the second portion are not displayed at the same time.

23. A device comprising:

interface means to generate a user interface for display at a display device, wherein the user interface includes a portion of content determined based on a viewing orientation of a user relative to the display device; and

orientation detection means to determine the viewing orientation and to detect a change in the viewing orientation;

wherein the interface means determines a first portion of the content based on a first viewing orientation, wherein the first portion includes at least a first viewable element of the content and does not include at least one second viewable element of the content;

wherein the interface means determines a second portion of the content in response to a change in the viewing orientation to a second viewing orientation, the second portion of the content including at least the second viewable element;

wherein a display difference between the first portion and the second portion is non-linearly related to an orientation difference between the first viewing orientation and the second viewing orientation; and

wherein the second viewable element includes a plurality of independent display windows, and wherein a first independent display window of the plurality of independent display windows is a user interface display of a first application operating at the device, and a second independent display window of the plurality of independent display windows is a user interface display of a second application operating at the device.

24. The device of claim 23, wherein the interface means continues to update the portion of the content displayed while the orientation detection means indicates that the orientation difference satisfies a threshold.

25. The device of claim 24, wherein a rate at which the interface means updates the portion of the content displayed is non-linearly related to a magnitude of the orientation difference.

26. The device of claim 24, wherein the orientation difference is determined based on a measured change in a viewing angle of the user relative to the display device.

27. The device of claim 26, wherein the orientation detection means measures the change in the viewing angle using a camera associated with the display device.

28. The device of claim 24, wherein detecting the change in the viewing orientation includes at least one of:

detecting a location of an eye of the user and detecting a location of at least a portion of a user'"'"'s face.

29. The device of claim 24, further comprising movement detection means to detect movement of the display device, wherein the change in the viewing orientation is determined based at least in part on a measured movement of the display device.

30. The device of claim 24, wherein a third portion of the content is determined in response to a change in the viewing orientation from the second viewing orientation to a third viewing orientation, wherein a second display difference between the second portion and the third portion is greater than the display difference between the first portion and the second portion.

31. The device of claim 23, wherein the first independent display window of the plurality of independent display windows is a user interface display of a first instance of the first application, and a third independent display window of the plurality of independent display windows is a user interface display of a second instance of the first application.

32. The device of claim 23, wherein the interface means comprise means for determining a cylindrical representation of the displayable content, wherein the cylindrical representation includes a single curved face, wherein the first portion and the updated portion correspond to portions of the cylindrical representation, and the display difference corresponds to an amount of rotation of the cylindrical representation about an axis.

33. The apparatus of claim 23, wherein the interface means generate the user interface to include the first portion of the content at a first time, and wherein the interface means generate the user interface to include the second portion of the content at a second time that is subsequent to the first time, such that the first portion and the second portion are not displayed at the same time.

34. A non-transitory computer-readable medium comprising processor-executable instructions that, when executed by one or more processors, cause the one or more processors of a device to:

determine a viewing orientation of a user relative to a display;

provide a portion of displayable content to the display based on the viewing orientation, wherein the portion includes at least a first viewable element of the content and does not include at least one second viewable element of the content;

determine an updated viewing orientation of the user; and

update the portion of the displayable content based on the updated viewing orientation, wherein the updated portion includes at least the second viewable element, wherein a display difference between the portion and the updated portion is non-linearly related to an orientation difference, and wherein the second viewable element includes a plurality of independent display windows, and wherein a first independent display window of the plurality of independent display windows is a user interface display of a first application operating at the device, and a second independent display window of the plurality of independent display windows is a user interface display of a second application operating at the device.

35. The non-transitory computer-readable medium of claim 34, wherein the instructions are further executable by the one or more processors to generate a three-dimensional representation of the content comprising a plurality of viewable elements of the content, wherein the portion corresponds to part of the three-dimensional representation.

36. The non-transitory computer-readable medium of claim 35, wherein the orientation difference corresponds to a change of viewing angle of the user relative to the display.

37. The non-transitory computer-readable medium of claim 36, wherein the display difference corresponds to a rate of rotation of the three-dimensional representation, and wherein the rate of rotation of the three-dimensional representation is non-linearly related to the orientation difference.

38. The non-transitory computer-readable medium of claim 35, wherein the three-dimensional representation includes the plurality of viewable elements arranged in a cylindrical configuration.

39. The non-transitory computer-readable medium of claim 34, wherein the instructions are executable by the one or more processors to continue to update the portion as long as the orientation difference exceeds a threshold.

40. The non-transitory computer-readable medium of claim 39, wherein a rate at which the portion continues to be updated is non-linearly related to the orientation difference.

41. The non-transitory computer-readable medium of claim 34, wherein the first and the second viewable elements include independent display windows.

42. The non-transitory computer-readable medium of claim 41, wherein the first viewable element is an independent display window.

43. The non-transitory computer-readable medium of claim 42, wherein the first independent display window of the plurality of independent display windows is a user interface display of a first instance of the first application, and a third independent display window of the plurality of independent display windows is a user interface display of a second instance of the first application.

44. The non-transitory computer-readable storage medium of claim 34, wherein the instructions are further executable by the one or more processors to determine a cylindrical representation of the displayable content based on a display size of the display, wherein the cylindrical representation includes a single curved face, wherein the first portion and the updated portion correspond to portions of the cylindrical representation, and the display difference corresponds to an amount of rotation of the cylindrical representation about an axis.

45. The non-transitory computer-readable storage medium of claim 34, wherein the instructions that cause the processor to provide the portion of the content comprise instructions that cause the processor to provide the portion of the content at a first time, and wherein the instructions that cause the processor to update the portion of the displayable content comprise instructions that cause the processor to update the portion of the displayable content at a second time that is subsequent to the first time, such that the first portion and the second portion are not provided to the display at the same time.