Methods and Systems for Ergonomic Feedback Using an Image Analysis Module

• US 20120256820A1
• Filed: 04/08/2011
• Published: 10/11/2012
• Est. Priority Date: 04/08/2011
• Status: Active Grant

• Current Assignee: Nan Chang O-Film Optoelectronics Technology, Ltd.
• Original Assignee: Nan Chang O-Film Optoelectronics Technology, Ltd.
• Inventors: Mehra, Sumat, Uppuluri, Avinash, Morales, Celia, Chakravarthula, Harl, Paoletti, Tomaso
• Granted Patent: US 8,913,005 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions

Abstract

A display device can be used with an ergonomic sensor comprising an imaging device interfaced to processing hardware to obtain and analyze image data depicting a user of the display device. The ergonomic sensor can be preconfigured with data indicating ergonomic uses of the display device so that the image of the user can be analyzed with minimal or no user calibration or setup. Instead, the ergonomic sensor can analyze the image data to provide real-time feedback, such as warnings or suggestions when the user'"'"'s behavior falls outside an ergonomic use range for the display device. In some implementations, the ergonomic sensor is integrated with the display device, though in other implementations a separate element or preexisting imaging device can be used.

Claims

1. An ergonomic sensor module configured for use with a display device, the sensor module comprising:

an image sensing device;

a processing element; and

an input/output interface,

wherein the processing element is configured to obtain image data from the image sensing device and analyze the image data to determine, based on predefined data defining an ergonomic use range of the display device, whether the image data indicates that a user of the display is using the display within the ergonomic use range.

2. The sensor module of claim 1, wherein the input/output interface is connected to the display device and the processing element is further configured to output a feedback message using the display device in response to determining that the image data indicates that a user of the display is not using the display within the ergonomic use range.

3. The sensor module of claim 1, integrated into a structural element of the display device.

4. The sensor module of claim 1, configured as a separate element attached to the display device.

5. The sensor module of claim 1, interfaced to a processing device that is also interfaced to the display device.

6. The sensor module of claim 1, wherein analyzing the image data to determine whether the image data indicates that a user of the display is using the display within the ergonomic use range comprises:

applying an image analysis algorithm to the image data to determine a lighting condition and determining whether the lighting condition is outside the ergonomic use range.

7. The sensor module of claim 1, wherein analyzing the image data to determine whether the image data indicates that a user of the display is using the display within the ergonomic use range comprises:

analyzing the image data to determine at least one of a distance or viewing angle of the user relative to the display device and determining whether the distance or viewing angle is outside the ergonomic use range.

8. The sensor module of claim 1, wherein analyzing the image data to determine whether the image data indicates that a user of the display is using the display within the ergonomic use range comprises:

analyzing the image data to determine whether the user has stared without blinking beyond a threshold period of time defined in the ergonomic use range.

9. The sensor module of claim 1, wherein analyzing the image data to determine whether the image data indicates that a user of the display is using the display within the ergonomic use range comprises:

analyzing the image data to determine at least one of the user'"'"'s face roll angle, yaw angle, or pitch angle relative to the display to determine if the user'"'"'s face is within an ergonomic use range based on the determined angle or angles.

10. The sensor module of claim 1, wherein analyzing the image data to determine whether the image data indicates that a user of the display is using the display within the ergonomic use range comprises:

analyzing the image data to identify multiple users in view and select one of the users, the image data of the selected user analyzed to determine if the selected user is using the display within the ergonomic use range.

11. The sensor module of claim 1, wherein analyzing the image data to determine whether the image data indicates that a user of the display is using the display within the ergonomic use range comprises:

analyzing the image data to determine whether the user has been proximate the display beyond a threshold length of time without a break.

12. The sensor module of claim 1, wherein the processing element comprises hardware logic interfaced to the sensor, the hardware logic configured to analyze the image data to determine whether the image data indicates that the user is using the display within the ergonomic use range.

13. The sensor module of claim 1, wherein the processing element is configured to analyze the image data to determine whether the image data indicates that a user of the display is using the display within the ergonomic use range independently of a shape of the user'"'"'s face.

14. The sensor module of claim 1, wherein the processing element is configured to analyze the image data to determine whether the image data indicates that a user of the display is using the display within the ergonomic use range independently of a change in ambient lighting conditions.

15. The sensor module of claim 1, wherein the processing element is configured to analyze the image data to determine whether the image data indicates that a user of the display is using the display within the ergonomic use range independently of precaptured posture data for the user.

16. The sensor module of claim 1, wherein the processing element is configured to determine an orientation of the display device.

17. A computerized method, comprising:

accessing image data from an image sensing device, the image data depicting a user of a display device;

analyzing the image data to determine, based on predefined data defining an ergonomic use range of the display device, whether the image data indicates that the user of the display is using the display within the ergonomic use range.

18. The computerized method of claim 17, further comprising:

providing output data representing a feedback message to be displayed in real-time using the display device in response to analyzing.

19. The computerized method of claim 18, wherein the feedback message indicates that the user of the display is not using the display within the ergonomic use range.

20. The computerized method of claim 17, further comprising:

determining an orientation of the display device.

21. A computer program product comprising a non-transitory computer-readable medium embodying program code, the program code comprising:

code for accessing image data from an image sensing device, the image data depicting a user of a display device; and

code for analyzing the image data to determine, based on predefined data defining an ergonomic use range of the display device, whether the image data indicates that the user of the display is using the display within the ergonomic use range.

22. The computer program product of claim 21, further comprising:

code for providing output data representing a feedback message to be displayed in real-time using the display device in response to analyzing.

23. The computer program product of claim 22, wherein the feedback message indicates that the user of the display is not using the display within the ergonomic use range.