Method and system for controlling a user interface a corresponding device and software devices for implementing the method

• US 20060265442A1
• Filed: 09/23/2004
• Published: 11/23/2006
• Est. Priority Date: 10/01/2003
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Palayur, Saju
• Application Number:
  US10/569,214
• Publication Number:
  US 20060265442A1
• Time in Patent Office: Days
• US Class Current: 708/200
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 10/242 by image rotation, e.g. by 90 degrees
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264

Abstract

The invention relates to method for controlling the orientation (O_info) of information (INFO) shown for a user (21) on a display (20), in which the information (INFO) has a target orientation (O_itgt) In method: the orientation (O_display) of the display (20) is defined relative to the information (INFO) shown on the display (20); and if the orientation (O_info) of the information (INFO) shown on the display (20) differs from the target orientation (O_itgt), then a change of orientation (ΔO) is implemented, as result of which change the orientation (O_info) of the information (INFO) shown on the display (20) is made to correspond to the target orientation (O_itgt).The orientation (O_display) of the display (20) is defined, in a set manner at intervals, by using a camera means (11) connected operationally to the display (20).

Claims

1. A method for controlling the orientation (O_info) of information (INFO) shown for at least one user on a display, in which the information (INFO) has a target orientation (O_itgt), and in which method

the orientation (O_display) of the display is defined relative to the orientation (O_info) of the information (INFO) shown on the display, by using at least viewfinder imaging enabling camera means connected operationally to the display to form image information (IMAGEx), which is analysed to find one or more selected features and to define its/their orientation (O_eyeline) in the image information (IMAGEx) and

if the orientation (O_info) of the information (INFO) shown on the display differs from the target orientation (O_itgt) set for it, then a change of orientation (Δ

O) is implemented, as result of which change the orientation (O_info) of the information (INFO) shown on the display is made to correspond to the target orientation (O_itgt),

characterized in that the definition of the orientation is performed at intervals, in such a way that the camera means are used to form image information (IMAGEx) for the purpose of the definition of the orientation less frequently, relative to their continuous viewfinder detection frequency.

2. A method according to claim 1, characterized in that the head of at least one user is selected as the image subject of the image information (IMAGEx).

3. A method according to claim 2, characterized in that the selected feature comprises facial features of at least one user, which are analysed using facial feature analysis, in order to find one or more facial features.

4. A method according to claim 3, characterized in that the, facial feature is, for example, the eye points of at least one user, in which the selected feature is, for example, the eye line defined by the eye points.

5. A method according to claim 1, characterized in that the definition of the orientation pe^rformed at intervals of 1-5 seconds, for example, intervals of 2-4 seconds, preferably intervals of 2-3 seconds.

6. A method according to claim 1, characterized in that 30-95%, for example, 50-80%, however, preferably less than 90% of the device resources are reserved for the definition of the orientation.

7. A method according to claim 1, characterized in that at least two users are detected from the image information (IMAGEx), from the facial features of whom an average value is defined, which is set to correspond to the said feature.

17. Software means for implementing the method according to claim 1, in which are arranged operationally in connection with the display

camera means enabling at least viewfinder imaging for forming image information (IMAGEx), image information (IMAGEx) is arranged to be analysed using by the software means applying one or more selected algorithms for defining the orientation (O_display) of the display, relative to the orientation (O_info) of the information (INFO) shown on the display,

software means for changing the orientation (Oinfo) of the information (INFO) shown on the display to the target orientation (O_itgt) set for it, if the orientation (O_display) of the display and the orientation (O_info) of the information (INFO) shown on the display differ from each other in a set manner,

characterized in that the software means for defining the orientation (O_display) of the display and, on its basis for setting the orientation (O_info) of the information (INFO), are arranged to perform at intervals, in such a way that the camera means are arranged to form image information (IMAGEx) for the purpose of the definition of the orientation less frequently, relative to their continuous viewfinder detection frequency.

18. Software means according to claim 17, characterized in that a facial-feature analysis is arranged to be used in the definition of the orientation.

19. Software means according to claim 17, characterized in that the definition of the orientation is arranged to be performed at intervals of 1-5 seconds, for example, intervals of 2-4 seconds, preferably intervals of 2-3 seconds.

20. Software means according to claim 17, characterized in that 30-95%, for example, 50-80%, however, preferably less than 90%, of the device resources are arranged to be reserved for the definition of the orientation.

21. Software means according to claim 17, characterized in that at least two users are arranged to be detected from the image information (IMAGEx), from the facial features of whom an average value is arranged to be defined, on the basis of which the orientation (O_display) of the display is arranged to be defined.

8. A system for controlling the orientation (O_info) of the information (INFO) shown for at least one user on a display in a device in which the system includes

a display arranged in connection with the vice for showing the information (INFO),

camera means arranged operationally in connection with the device and enabling at least viewfinder imaging, for forming image information (IMAGEx), from which image information (IMAGEx) the orientation (O_display) of the display is arranged to be defined relative to the orientation (O_info) of the information (INFO) shown on the display,

means for changing the orientation (O_info) of the information (INFO) shown on the display to the target orientation (O_itgt) set for it, if the orientation (O_display) of the display and the orientation (O_info) of the information (INFO) shown on the display differ from each other in a set manner,

characterized in that the definition of the orientation of the display is arranged to be performed at intervals, in such a way that the camera means are arranged to form image information (IMAGEx) for the purpose of the definition of the orientation less frequently, relative to their continuous viewfinder detection frequency.

9. A system according to claim 8, characterized in that the image subject of the image information (IMAGEx) is selected as at least one user being next to the device, in which case the system includes a facial-feature analysis functionality for finding parts of the face of one or several users from the image information (IMAGEx), in which defined feature, relative to the image information (IMAGEx), the orientation (O_display) of said display is arranged to be defined.

10. A system according to claim 8, characterized in that the definition of the orientation is arranged to be performed at intervals of 1-5 seconds, for example, intervals of 2-4 seconds, preferably intervals of 2-3 seconds.

11. A system according to of claim 8, characterized in that 30-95%, for example, 50-80%, however, preferably less than 90% of the device resources are arranged to be used for the definition of the orientation.

12. A system according to claim 8, characterized in that at least two users are arranged to be detected from the image information (IMAGEx), from the facial features of whom an average value is arranged to be defined, which is arranged to be set to correspond to the said feature.

13. A portable device, in connection with which are arranged

a display for showing information (INFO),

camera means arranged operationally in connection with the device and enabling at least viewfinder imaging for forming image information (IMAGEx), from which image information (IMAGEx) the orientation (O_display) of the display, relative to the orientation (O_info) of the information (INFO) shown on the display is arranged to be defined and

means for changing the orientation (O_info) of the information (INFO) shown on the display to the target orientation (O_itgt) set for it, if the orientation (O_display) of the display and the orientation (O_info) of the information (INFO) shown on the display differ from each other in a set manner,

characterized in that the definition of the display is arranged to be performed at intervals, in such a way that the camera means are arranged to form image information (IMAGEx) for the purpose of definition of the orientation less frequently, relative to their continuous viewfinder detection frequency.

14. A device according to claim 13, characterized in that the definition of the orientation is arranged to be performed at intervals of 1-5 seconds, for example, intervals of 2-4 seconds, preferably intervals of 2-3 seconds.

15. A device according to claim 13, characterized in that 30-95%, for example, 50-80%, however, preferably less than 90% of the device resources are arranged to be used for the definition of the orientation.

16. A device according to any of claim 13, characterized in that at least two users are arranged to be detected from the image information (IMAGEx), from the facial features of whom an average value is arranged to be defined, on the basis of which the orientation (O_display) of the display is arranged to be defined.