Displaying an image on an irregular screen

• US 9,959,027 B1
• Filed: 07/31/2017
• Issued: 05/01/2018
• Est. Priority Date: 07/03/2017
• Status: Active Grant

• Current Assignee: Essential Products, Inc.
• Original Assignee: Essential Products, Inc.
• Inventors: Gajulapally, Adithya, Kolb, Michael, Zavin, Rebecca Schultz
• Primary Examiner(s): Nguyen, Tuan S
• Application Number:
  US15/665,332
• Time in Patent Office: 274 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/145 related to small screens
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

Presented here are systems and methods to enable software applications to display images on irregular screen shapes containing the shape without display functionality. In one embodiment, the shape without display functionality is confined within a bounding shape, which, when subtracted from the irregular screen shape leaves a rectangular area of the screen where the image can be displayed. The area within the bounding shape can be occupied by images provided by the operating system associated with the irregular screen, such as a status bar and/or navigation bar. In another embodiment, the image can be displayed on the full irregular screen, such that the shape without display functionality covers a part of the image. When the occluded part of the image contains a critical object, such as a menu item, a button, etc., the image can be modified to move the critical object out of the area occluded by the shape without display functionality.

Claims

1. A method comprising:

receiving a first image to display on a nonrectangular display area having a display functionality, the nonrectangular display area defining a shape without display functionality, the first image comprising a first critical object occupying a first portion of the first image;

receiving a second image to display on the nonrectangular display area, the second image comprising a second critical object occupying a second portion of the second image;

determining a position of the second image on the nonrectangular display area, wherein the position encompasses the shape without display functionality;

when the second critical object at least partially overlaps the shape without display functionality, modifying the second image by moving the second critical object to a different portion of the second image, wherein the different portion of the second image does not overlap the shape without display functionality; and

displaying the first and the second image on the nonrectangular display area, the first critical object and the second critical object fully contained in the nonrectangular display area having display functionality.

2. A method comprising:

receiving a first image to display on a nonrectangular display area having a display functionality, the nonrectangular display area defining a shape without display functionality, the first image comprising a first critical object occupying a first portion of the first image; and

displaying the first image on the nonrectangular display area by modifying the first image to place the first critical object on the nonrectangular display area, the first critical object fully contained within the nonrectangular display area having display functionality.

3. The method of claim 2, comprising:

identifying the first critical object within the first image, wherein the first critical object comprises a menu item, or a graphical user interface button.

4. The method of claim 2, said modifying comprising:

determining a bounding shape containing the shape without display functionality;

defining a rectangular display area by subtracting the bounding shape from the nonrectangular display area; and

displaying the first image within the rectangular display area.

5. The method of claim 2, comprising:

receiving a second image to display on the nonrectangular display area, the second image comprising a second critical object occupying a second portion of the second image;

determining a position of the second image on the nonrectangular display area, wherein the position encompasses the shape without display functionality;

when the second critical object at least partially overlaps the shape without display functionality, modifying the second image by moving the second critical object to a different portion of the second image, wherein the different portion of the second image does not overlap the shape without display functionality; and

displaying the modified image on the nonrectangular display area.

6. The method of claim 5, the second image comprising at least one of a mobile device status bar, or a mobile device navigation bar.

7. The method of claim 2, said modifying comprising:

receiving a request from an application to display the first image on a full nonrectangular display area;

checking a permission list indicating whether the application has permission to utilize the full nonrectangular display area; and

upon confirming that the application is included in the permission list, displaying the first image on the full nonrectangular display area, said displaying comprising occluding a part of the first image by the shape without display functionality.

8. The method of claim 2, said modifying comprising:

determining an orientation of the nonrectangular display area, the orientation comprising a portrait and a landscape;

based on the orientation of the nonrectangular display area, modifying at least one of the first image or the nonrectangular display area.

9. The method of claim 8, said modifying comprising:

receiving a request from an application to display the first image on a full nonrectangular display area;

checking a permission list associated with the orientation of the nonrectangular display area, the permission list indicating whether the application has permission to utilize the full nonrectangular display area when the nonrectangular display area is associated with the determined orientation; and

upon confirming that the application is included in the permission list associated with the orientation of the nonrectangular display area, displaying the first image on the full nonrectangular display area, said displaying comprising occluding a part of the first image by the shape without display functionality.

10. The method of claim 2, comprising:

providing to an application associated with a user a widget to adjust a position of the first image within the nonrectangular display area;

receiving from the application a preferred position associated with the application; and

displaying the first image in the preferred position.

11. The method of claim 10, comprising:

tracking the preferred position associated with the application;

based on a plurality of preferred positions associated with a plurality of users, determining a best preferred position, wherein the best preferred position is specified by the highest number of users in the plurality of users; and

specifying a default display associated with the application to be the best preferred position.

12. An apparatus comprising:

a nonrectangular display area having a display functionality, the nonrectangular display area defining a shape without display functionality;

a processor to control;

a communication module to receive a first image to display on the nonrectangular display area, the first image comprising a first critical object occupying a first portion of the first image; and

a display module to display the first image on the nonrectangular display area by modifying the first image, and placing the first critical object on the nonrectangular display area, the first critical object fully contained within the nonrectangular display area having display functionality.

13. The apparatus of claim 12, an identification module to:

identify the first critical object within the first image, the first critical object comprising a menu item, or a text.

14. The apparatus of claim 12, the display module to:

determine a bounding shape containing the shape without display functionality;

define a rectangular display area by subtracting the bounding shape from the nonrectangular display area; and

display the first image on the rectangular display area.

15. The apparatus of claim 12, comprising:

the communication module to receive a second image to display on the nonrectangular display area, the second image comprising a second critical object occupying a second portion of the second image;

the display module to determine a position of the second image on the nonrectangular display area, the position encompassing the shape without display functionality;

when the second critical object at least partially overlaps the shape without display functionality, the display module to modify the second image by moving the second critical object to a different portion of the second image, wherein the different portion of the second image does not overlap the shape without display functionality; and

the display module to display the modified image on the nonrectangular display area.

16. The apparatus of claim 12, comprising:

the communication module to receive a request from an application to display the first image on a full nonrectangular display area;

the display module to check a permission list indicating whether the application has permission to utilize the full nonrectangular display area; and

upon confirming that the application is included in the permission list, the display module to display the first image on the full nonrectangular display area, said displaying comprising occluding a part of the first image by the shape without display functionality.

17. The apparatus of claim 12, comprising:

the display module to determine an orientation of the nonrectangular display area, the orientation comprising a portrait and a landscape;

based on the orientation of the nonrectangular display area, the display module to modify at least one of the first image or the nonrectangular display area.

18. The apparatus of claim 17, said modifying comprising:

the communication module to receive a request from an application to display the first image on a full nonrectangular display area;

the display module to check a permission list associated with the orientation of the nonrectangular display area, the permission list indicating whether the application has permission to utilize the full nonrectangular display area when the nonrectangular display area is associated with the determined orientation; and

upon confirming that the application is included in the permission list associated with the orientation of the nonrectangular display area, the display module to display the first image on the full nonrectangular display area, said displaying comprising occluding a part of the first image by the shape without display functionality.

19. The apparatus of claim 12, comprising:

the communication module to provide to an application associated with a user a widget to adjust a position of the first image within the nonrectangular display area;

the communication module to receive from the application a preferred position associated with the application; and

the display module to display the first image in the preferred position.

20. The apparatus of claim 19, comprising:

the communication module to track the preferred position associated with the application;

based on a plurality of preferred positions associated with a plurality of users, the display module to determine a best preferred position, wherein the best preferred position is specified by the highest number of users in the plurality of users; and

the display module to specify a default display associated with the application to be the best preferred position.