System and Method for Analyzing Three-Dimensional (3D) Media Content

• US 20130156265A1
• Filed: 02/11/2013
• Published: 06/20/2013
• Est. Priority Date: 08/16/2010
• Status: Active Grant

• Current Assignee: Mirametrix Inc. (Lattice Semiconductor Corporation)
• Original Assignee: TandemLaunch Technologies, LLC
• Inventors: Hennessy, Craig Adam
• Granted Patent: US 8,913,790 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Abstract

A system and method are provided that use point of gaze information to determine what portions of 3D media content are actually being viewed to enable a 3D media content viewing experience to be improved. Tracking eye movements of viewers to obtain such point of gaze information are used to control characteristics of the 3D media content during consumption of that media, and/or to improve or otherwise adjust or refine the 3D media content during creation thereof by a media content provider. Outputs may be generated to illustrate what in the 3D media content was viewed at incorrect depths. Such outputs may then be used in subsequent or offline analyses, e.g., by editors for media content providers when generating the 3D media itself, in order to gauge the 3D effects. A quality metric can be computed based on the point of gaze information, which can be used to analyze the interactions between viewers and the 3D media content being displayed. The quality metric may also be calibrated in order to accommodate offsets and other factors and/or to allow for aggregation of results obtained for multiple viewers.

Claims

1. A method of analyzing three dimensional (3D) media content, the method comprising:

obtaining point of gaze (POG) information from an eye tracking system;

determining a vergence value using the POG information;

comparing the vergence value to depth data associated with at least one object in the 3D media content; and

providing an output based on the comparing.

2. The method of claim 1, wherein the comparing generates a depth error value indicative of a difference between a viewed depth and a displayed depth for the at least one object.

3. The method of claim 2, wherein the output comprises a control instruction for modifying the 3D media content according to the depth error value.

4. The method of claim 3, wherein the modifying comprises adjusting focus of one or more of the at least one object in the 3D media content.

5. The method of claim 4, wherein the modifying is performed while the 3D media content is being displayed for a viewer.

6. The method of claim 4, wherein the modifying is performed offline during an analysis of the 3D media content subsequent to being displayed for a viewer.

7. The method of claim 1, further comprising calibrating the vergence value.

8. The method of claim 7, wherein the calibrating comprises:

displaying a plurality of test object at different depths in the 3D media content;

determining a respective vergence value at each depth; and

computing one or more calibration parameters according to the determined vergence values.

9. The method of claim 8, wherein the test objects are provided without prompting a viewer.

10. The method of claim 8, wherein the test objects are provided using a prompt provided to a viewer.

11. The method of claim 8, further comprising repeating the calibrating.

12. The method of claim 8, wherein the one or more calibration parameters comprise any one or more of a function, and a look-up table.

13. The method of claim 1, wherein the output comprises any one or more of a contour map, false colour shading, and error heatmap showing differences between a viewed depth and a displayed depth for the at least one object.

14. The method of claim 1, wherein the POG information is a 3D value and the vergence value is obtained from a dimension of the 3D value.

15. The method of claim 1, wherein the POG information provides left eye POG and right eye POG values on a two dimensional (2D) display screen.

16. The method of claim 15, wherein the vergence value is computed by determining a relative distance between the left eye POG and right eye POG in one dimension.

17. The method of claim 16, wherein the one dimension accounts for head tilt associated with a viewer.

18. The method of claim 16, wherein a left eye x-coordinate is subtracted from a right eye POG x-coordinate, wherein an x-axis is measured along a horizontal edge of a display screen, and wherein a positive vergence value is indicative of POG further into the 3D media content then the display screen, a negative vergence value is indicative of POG between the display screen and a viewer of the 3D media content, and a zero vergence value is indicative of POG on the display screen.

19. The method of claim 1, wherein the output comprises an analysis of content being viewed.

20. The method of claim 19, wherein the analysis provides content of interest.

21. A computer readable storage medium comprising computer executable instructions for analyzing three dimensional (3D) media content, the computer executable instructions comprising instructions for performing the method according to claim 1.

22. An electronic device comprising a processor and memory, the memory comprising computer executable instructions for causing the processor to analyze three dimensional (3D) media content, the computer executable instructions comprising instructions for performing the method according to claim 1.

23. A media player comprising the electronic device of claim 22.

24. A system comprising electronic device of claim 22, and an eye tracking system.