Display system with image sensor based display orientation

• US 9,494,973 B2
• Filed: 05/09/2012
• Issued: 11/15/2016
• Est. Priority Date: 05/09/2012
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Hallerstrm Sjstedt, Svante Magnus Ulfstand, Eriksson, Marcus
• Primary Examiner(s): Shah, Priyank
• Application Number:
  US13/467,495
• Publication Number:
  US 20130300671A1
• Time in Patent Office: 1,651 Days
• Field of Search: 345/173
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1649 the additional display being independently orientable, e.g. for presenting information to a second user
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode

Abstract

A display system with image sensor based display orientation is provided. The display system comprises: a display device; a sensor for acquiring at least one electronic image from a field of view proximal the display device; and a processor enabled to: control at least a subset of the display device to a display orientation associated with a given edge of the display device when a portion of the at least one electronic image associated with the given edge comprises a given reference image.

Claims

1. A display system comprising:

a touchscreen device

a display device;

a housing comprising the display device;

a sensor for acquiring at least one non-touch electronic image from a field of view over the display device the sensor located proximal the display device; and

a processor configured to;

render an image at the display device such that a rendered image is provided at the display device, all of the rendered image initially oriented in a same display orientation at the display device;

after the rendered image is provided at the display device, receive, using the touchscreen device, circling touch input circling a first subset of the rendered image at the display device, the circling touch input identifying the first subset of the rendered image which is initially oriented in the same display orientation as a remaining portion of the rendered image at the display device;

after receiving the circling touch input, acquire at the sensor the at least one non-touch electronic image associated with a given edge of the display device, the given edge adjacent the first subset of the rendered image at the display device; and

, after the at least one non-touch electronic image associated with a given edge of the display device is acquired and when a portion of the at least one non-touch electronic image comprises a given reference image,

change the first subset of the rendered image at the display device from the same display orientation to a rotated display orientation oriented with the given edge, the rotated display orientation different from the same display orientation while leaving the second subset of the rendered image at the display device unchanged in the same display orientation.

2. The display system of claim 1, wherein the sensor comprises at least one of:

a camera device;

a CMOS (Complementary metal-oxide-semiconductor) image sensor; and

a CCD (charge-coupled device) image sensor.

3. The display system of claim 1, wherein the display device comprises at least one of a cathode ray tube, a flat panel display, a liquid crystal display (LCD), an organic light emitting diode, a plasma display, and a touchscreen.

4. The display system of claim 1, wherein the housing further comprises the sensor located proximal the display device.

5. The display system of claim 1, wherein the given reference image comprises at least one of:

a body part, a hand, a face, a foot, and a stylus.

6. The display system of claim 1, wherein, the same display orientation is oriented with an edge opposite the given edge.

7. The display system of claim 1, wherein the same display orientation is one of a first landscape orientation and a first portrait orientation, and the rotated display orientation is one of a second landscape orientation rotated 180°

to the first landscape orientation and second portrait orientation rotated 180°

to the first portrait orientation.

8. The display system of claim 1, wherein the display device is a quadrilateral, and the given edge comprises a specific edge of the quadrilateral.

9. The display system of claim 1, wherein the display device comprises a plurality of edges, wherein each respective edge of the display device is associated with respective display orientations of the display device and the processor is further configured to:

change the first subset of the rendered image at the display device to a respective display orientation when the given reference image is determined to be in a respective portion of the at least one non-touch electronic image associated with a respective edge, while leaving the second subset of the rendered image at the display device unchanged in the same display orientation.

10. The display system of claim 1, wherein the processor is further configured to:

change the first subset of the rendered image at the display device to yet a further display orientation associated with two given edges of the display device when a portion of the at least one non-touch electronic image associated with the two given edges comprises the given reference image, while leaving the second subset of the rendered image at the display device unchanged in the same display orientation.

11. The display system of claim 1, wherein the processor is further configured to:

change the first subset of the rendered image at the display device to the rotated display orientation oriented with the given edge when the portion of the non-touch electronic image comprises the given reference image for a given time period.

12. The display system of claim 1, further comprising an apparatus for determining an incline of the display device, the processor further configured to:

when the portion of the at least one non-touch electronic image comprises the given reference image and the display device is about level;

change the first subset of the rendered image at the display device to the rotated display orientation, while leaving the second subset of the rendered image at the display device unchanged in the same display orientation.

13. The display system of claim 1, wherein the processor is further configured to determine that the portion of the at least one non-touch electronic image comprises the given reference image by one or more of:

processing the at least non-touch one electronic image;

computer vision;

comparing at least a subset of the at least one non-touch electronic image to the given reference image stored at a memory; and

,

applying mathematical rules associated with the given reference image to the at least one non-touch electronic image.

14. The display system of claim 1, wherein the processor is further configured to acquire and store data associated with the given reference image in a learning mode.

15. The display system of claim 1, wherein the processor is further configured to:

change the first subset of the rendered image at the display device to the rotated display orientation when the portion of the at least one non-touch electronic image comprises a given one of a plurality of given reference images, the plurality of given reference images comprising the given reference image.

16. The display system of claim 15, wherein a number of the plurality of given reference images is less than or equal to a given maximum number.

17. The display system of claim 1, further comprising a tablet device, the tablet device comprising the sensor, the display and the processor.

18. The display system of claim 1, wherein the first subset of the rendered image at the display device identified by the circling touch input comprises a selection of a bisection of the display device.