Change screen orientation

• US 8,358,321 B1
• Filed: 04/29/2011
• Issued: 01/22/2013
• Est. Priority Date: 04/29/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Weidner, Klaus
• Primary Examiner(s): Sams, Michelle L
• Application Number:
  US13/097,558
• Time in Patent Office: 634 Days
• Field of Search: 345/649, 345/659, 345/619
• US Class Current: 345/659
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2358/00 Arrangements for display data security
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A method, computer program product, and system are provided for orienting content on a display. The method may include identifying one or more features of a user in a captured image. A user orientation axis is determined in the captured image. A content orientation axis corresponding to an orientation direction of a screen content is defined. A determination is made as to whether the content orientation axis and the user orientation axis are parallel or perpendicular. The orientation direction of the screen content is changed to be substantially along the user orientation axis based on the determination of whether the content orientation axis and the user orientation axis are parallel or perpendicular. The screen content is then displayed.

Claims

1. A method performed by a computing device having a processor, the method comprising:

identifying, by the computing device, one or more features of a user in a captured image on a mobile device;

calculating a confidence metric for the identifying of the one or more features;

accessing stored user orientation axes of pictures stored on the mobile device;

determining a user orientation axis of the captured image in response to determining that the confidence metric exceeds a threshold value and determining the user orientation axis of a stored picture in response to determining that the confidence metric does not exceed a threshold value;

defining a content orientation axis corresponding to an orientation direction of a screen content;

determining whether the content orientation axis and the user orientation axis are parallel or perpendicular;

changing the orientation direction of the screen content to be substantially along the user orientation axis based on the determination of whether the content orientation axis and the user orientation axis are parallel or perpendicular; and

displaying the screen content on the mobile device.

2. The method of claim 1, wherein the user orientation axis is substantially parallel to a line passing between a left eye position of the user and a right eye position of the user, based on the one or more features.

3. The method of claim 1, wherein the screen content includes a line of text, further comprising:

rotating the screen content to align the content orientation axis so that a beginning of the line of text is positioned towards the left eye.

4. The method of claim 1, wherein the screen content includes a line of text further comprising:

rotating the screen content to align the content orientation axis so that an end of the line of text is positioned towards the right eye.

5. The method of claim 1, wherein the mobile device includes a camera and wherein the method further includes capturing the image using the camera.

6. The method of claim 1, wherein identifying one or more features includes identifying the one or more features from within an image of a partial outline of the user'"'"'s face.

7. The method of claim 1, wherein the one or more features includes an outline of the user'"'"'s face, and wherein identifying the user orientation axis is performed by identifying the user orientation axis based on the outline.

8. The method of claim 1, wherein the one or more features includes an outline of one or more individual facial features, and wherein identifying the user orientation axis is performed by identifying the user orientation axis based on the orientation of the outlines of the individual facial features.

9. The method of claim 1, further comprising:

selecting a display orientation based on the change of detected orientations over time.

10. The method of claim 1, further comprising:

storing a history of confidence metrics based on pictures taken at one or more time intervals; and

selecting a display orientation based on the change of detected orientations and confidence metrics over time.

11. The method of claim 1, wherein aligning the content orientation axis includes altering data sent to the mobile device to change the orientation of the displayed content.

12. The method of claim 1, further comprising:

selecting one of a plurality of predefined content display modes to align.

13. The method of claim 1, wherein defining a content orientation axis is performed by obtaining orientation information based on information included in the content and defining the content information based on the orientation information.

14. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

identifying one or more features of a user in a captured image;

calculating a confidence metric for the identifying of the one or more features;

accessing stored user orientation axes of pictures stored on the mobile device;

determining a user orientation axis of the captured image in response to determining that the confidence metric exceeds a threshold value and determining the user orientation axis of a stored picture in response to determining that the confidence metric does not exceed a threshold value;

defining a content orientation axis corresponding to an orientation direction of a screen content;

determining whether the content orientation axis and the user orientation axis are parallel or perpendicular

changing the orientation direction of the screen content to be substantially along the user orientation axis based on the determination of whether the content orientation axis and the user orientation axis are parallel or perpendicular; and

displaying the screen content.

15. The non-transitory computer storage medium of claim 14, wherein the user orientation axis is substantially parallel to a line passing between a left eye position of the user and a right eye position of the user, based on the one or more features.

16. The non-transitory computer storage medium of claim 14, wherein the operations further comprise:

calculating a confidence metric for the identifying of the one or more features based on the captured image.

17. The non-transitory computer storage medium of claim 16, wherein the operations further comprise:

performing the aligning the content orientation axis in response to the calculated confidence metric exceeding a threshold value.

18. A system comprising:

one or more computers; and

a computer-readable medium coupled to the one or more computers having instructions stored thereon which, when executed by the one or more computers, cause the one or more computers to perform operations comprising;

identifying one or more features of a user in a captured image;

calculating a confidence metric for the identifying of the one or more features;

accessing stored user orientation axes of pictures stored on the mobile device;

determining a user orientation axis of the captured image in response to determining that the confidence metric exceeds a threshold value and determining the user orientation axis of a stored picture in response to determining that the confidence metric does not exceed a threshold value;

defining a content orientation axis corresponding to an orientation direction of a screen content;

determining whether the content orientation axis and the user orientation axis are parallel or perpendicular

changing the orientation direction of the screen content to be substantially along the user orientation axis based on the determination of whether the content orientation axis and the user orientation axis are parallel or perpendicular; and

displaying the screen content.