METHODS FOR ENHANCING USER INTERACTION WITH MOBILE DEVICES

• US 20140160019A1
• Filed: 12/07/2012
• Published: 06/12/2014
• Est. Priority Date: 12/07/2012
• Status: Abandoned Application

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Lin, Michael, Anda, Venkata R., Zhang, Guanghua
• Application Number:
  US13/708,852
• Publication Number:
  US 20140160019A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 1/3265 Power saving in display device
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G09G 2330/022 in absence of operation, e.g. no data being entered during a predetermined time
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A method for enhancing user interaction with mobile electronic devices is presented. The method includes determining screen orientation on the device by first detecting the presence of a user using data captured by a camera of the portable electronic device. The method further includes searching the data from the camera for a plurality of physical characteristics of the user if a user is detected. The method also includes determining a facial orientation of the user based on information regarding at least one physical characteristic of the user determined from the data. Finally, the method includes setting a screen orientation of a display device of the portable electronic device based on the determined facial orientation of the user.

Claims

15. A computer-readable storage medium having stored thereon, computer executable instructions that, if executed by a computer system cause the computer system to perform a method for determining screen orientation on a portable electronic device, said method comprising:

detecting the presence of a user using data from a camera of the portable electronic device;

searching the data from the camera for a plurality of physical characteristics of the user if a user is detected;

determining a facial orientation of the user based on information regarding at least one physical characteristic of the user determined in the data; and

setting a screen orientation of a display device of said portable electronic device based on a determined facial orientation of the user.

1. A method for determining screen orientation on a portable electronic device, said method comprising:

detecting the presence of a user using data from a camera of the portable electronic device;

searching the data from the camera for a plurality of physical characteristics of the user if a user is detected;

determining a facial orientation of the user based on information regarding at least one physical characteristic of the user determined in the data; and

setting a screen orientation of a display device of said portable electronic device based on a determined facial orientation of the user.

2. The method of claim 1, further comprising capturing the data to perform said searching, wherein the data is selected from the group comprising:

image data and video data.

3. The method of claim 1, wherein the plurality of physical characteristics is selected from the group comprising:

head, face, eyes, nose, and lips.

4. The method of claim 1, wherein the information regarding the at least one physical characteristic comprises an orientation of the at least one physical characteristic of the user determined from the data.

5. The method of claim 1, wherein the information regarding the at least one physical characteristic comprises a location of the at least one physical characteristic of the user determined from the data.

6. The method of claim 1, further comprising enabling a screen timer for setting a screen in inactive mode if said detecting does not detect the presence of a user.

7. The method of claim 1, further comprising enabling a screen timer for setting a screen in brightness reduction mode if said detecting does not detect the presence of a user.

8. The method of claim 1, further comprising maintaining a screen in active mode if said detecting detects the presence of a user.

9. The method of claim 1, further comprising setting a screen orientation based on data received from an orientation sensor if said determining fails to determine the facial orientation.

10. The method of claim 1, further comprising adjusting a focus of the camera automatically based on the information regarding the at least one physical characteristic of the user determined from the data.

11. The method of claim 10, wherein the information regarding the at least one physical characteristic comprises a distance between the eyes of the user determined from the data.

12. The method of claim 10, wherein the information regarding the at least one physical characteristic comprises a width of the head of the user determined from the data.

13. The method of claim 1, wherein the detecting the presence of the user comprises using skin detection techniques.

14. The method of claim 1, wherein the detecting the presence of the user comprises using ambient background subtraction techniques.

16. The computer-readable medium as described in claim 15 wherein the plurality of physical characteristics is selected from the group comprising:

head, face, eyes, nose, and lips.

17. The computer-readable medium as described in claim 15 wherein the information regarding the at least one physical characteristic comprises an orientation of the at least one physical characteristic of the user determined from the data.

18. The computer-readable medium as described in claim 15 wherein the information regarding the at least one physical characteristic comprises a location of the at least one physical characteristic of the user determined from the data.

19. The computer-readable medium as described in claim 15 wherein said method further comprises enabling a screen timer for setting a screen in inactive mode if said detecting does not detect the presence of a user.

20. The computer-readable medium as described in claim 15 wherein said method further comprises enabling a screen timer for setting a screen in brightness reduction mode if said detecting does not detect the presence of a user.

21. The computer-readable medium as described in claim 15 wherein said method further comprises maintaining a screen in active mode if said detecting detects the presence of a user.

22. The computer-readable medium as described in claim 15 wherein said method further comprises setting the screen orientation based on data received from an orientation sensor if said determining fails to determine the facial orientation.

23. The computer-readable medium as described in claim 15 wherein said method further comprises adjusting a focus of the camera automatically based on the information regarding the at least one physical characteristic of the user determined from the data.

23-1. The computer-readable medium as described in claim 15 wherein said method further comprises capturing the data to perform said searching, wherein the data is selected from the group comprising:

image data and video data.

25. A system for determining screen orientation on a portable electronic device, said system comprising:

a display screen configured to display an image in a plurality of orientations;

a memory;

a camera; and

a processor configured to;

detect the presence of a user using data from the camera of the portable electronic device;

search the data from the camera for a plurality of physical characteristics of the user if a user is detected;

determine a facial orientation of the user based on information regarding at least one physical characteristic of the user determined in the data; and

set a screen orientation on the display screen based on a determined orientation of the user.