Image acquisition and display system and method using information derived from an area of interest in a video image implementing system synchronized brightness control and use of metadata

• US 8,982,146 B2
• Filed: 01/30/2008
• Issued: 03/17/2015
• Est. Priority Date: 01/30/2007
• Status: Active Grant

• Current Assignee: Fergason Licensing LLC
• Original Assignee: Fergason Patent Properties
• Inventors: Fergason, James L.
• Primary Examiner(s): Wu, Xiao M.
• Assistant Examiner(s): Cobb, Michael J
• Application Number:
  US12/525,098
• Publication Number:
  US 20100253846A1
• Time in Patent Office: 2,603 Days
• Field of Search: 345/619, 345/102, 382168-172, 382173-180, 382190-206, 382254-274, 382282-283, 385168-180, 385190-206, 385254-274, 385282-283
• US Class Current: 345/619
• CPC Class Codes: G09G 2320/0233 Improving the luminance or brightness uniformity across the screen
• CPC Class Codes: G09G 2320/0242 Compensation of deficiencies in the appearance of colours
• CPC Class Codes: G09G 2320/0271 Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping
• CPC Class Codes: G09G 2320/0646 Modulation of illumination source brightness and image signal correlated to each other
• CPC Class Codes: G09G 2360/16 Calculation or use of calculated indices related to luminance levels in display data
• CPC Class Codes: G09G 2370/04 Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
• CPC Class Codes: G09G 3/3406 Control of illumination source illumination devices structurally associated with liquid crystal cells G02F1/1336
• CPC Class Codes: G09G 3/3413 Details of control of colour illumination sources
• CPC Class Codes: G09G 3/3611 Control of matrices with row and column drivers
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 5/20 Circuitry for controlling amplitude response

Abstract

Method and apparatus for preparing and displaying images uses image characteristics of an area of interest of images to optimize or otherwise determine image characteristics of the entire image to be displayed. The area of interest information may be used in computing a System Synchronized Backlight Control (“SSBC”) profile for the area of interest, and the SSBC profile may be used to adjust the image signal to provide an image in which the image characteristics, e.g., are optimized for the image at the area of interest. The image characteristics and/or SSBC profile information may be provided as metadata included in a video signal data stream. The area of interest may be selected where the image is obtained, where the image is shown or elsewhere, e.g., in an image storage device, image player, etc.

Claims

1. A method of displaying an image at a display in a display system, the method comprising:

receiving an input signal, the input signal including image data representative of an image for display and encoded metadata indicative of an area of interest within the image, wherein the area of interest is less than the entire image;

decoding the encoded metadata to determine the area of interest within the image, the area of interest being represented by area of interest image data;

determining a range of grey levels and a brightness for the area of interest image data;

determining a display profile for the image based on the area of interest image data, the display profile providing an increase in the determined range of grey levels for the area of interest represented by the area of interest image data and illumination adjustment information for the area of interest;

applying the display profile to the image represented by the image data in real time by simultaneously stretching the range of grey levels of the image and adjusting illumination of the display; and

displaying the image based on the applied display profile on the display, wherein if the display system is not enabled to apply the display profile to the image, ignoring the metadata and displaying the image unaffected by the metadata.

2. The method of claim 1, wherein the display is a component of the display system further comprising an image signal receiver and said area of interest is defined at the image signal receiver.

3. The method of claim 1, wherein said encoded metadata indicative of the area of interest is generated at a camera that generates the image.

4. The method of claim 1, wherein said encoded metadata indicative of the area of interest is generated while editing the image.

5. The method of claim 1, wherein said encoded metadata indicative of the area of interest is generated at the display system.

6. The method of claim 1, wherein the display system further comprises an image player and said area of interest is performed at the image player.

7. The method of claim 1, wherein said encoded metadata indicative of the area of interest is generated at a video recorder that generates the image.

8. The method of claim 1, wherein encoding metadata indicative of the area of interest is carried out by a person selecting the area of interest.

9. The method of claim 1, wherein encoding metadata indicative of the area of interest is carried out automatically using an algorithm.

10. The method of claim 1, said stretching of the range gray levels comprising interpolating.

11. The method of claim 1, further comprising providing said display profile in a video signal stream.

12. The method of claim 1, wherein said display profile is included in said encoded metadata.

13. The method of claim 1, wherein the encoded metadata is provided in unused space of a video signal stream.

14. The method of claim 13, wherein said encoded metadata is provided in the video signal stream separate from video imagery in the video signal stream.

15. The method of claim 1, further comprising providing the illumination adjustment information and the increase in the determined range of grey levels for the area of interest in said encoded metadata for use in effecting adjustment of the image for display.

16. The method of claim 1, wherein the illumination adjustment information and the increase in the determined range of grey levels are calculated at an image source distant from the display system.

17. The method of claim 1, wherein illumination adjustment information and the increase in the determined range of grey levels are prepared where the image is obtained.

18. The method of claim 1, wherein the illumination adjustment information and the increase in the determined range of grey levels are prepared where the image is prepared or provided for displaying.

19. The method of claim 1, wherein the illumination adjustment information and the increase in the determined range of grey levels are prepared at the display system intended to display the image.

20. The method of claim 1, comprising using a relatively sharply in-focus portion of the image relative to another less sharply focused portion of the image to determine the area of interest.

21. The method of claim 1, comprising using face recognition software to determine a face in the image as the area of interest.

22. The method of claim 1, comprising using a relatively still object in the image relative to a moving background portion of the image to determine the area of interest.

23. The method of claim 1, comprising using a relatively moving object in the image relative to a still background portion of the image to determine the area of interest.

24. The method of claim 1, comprising using a relatively bright portion of the image relative to a relatively darker portion of the image to determine the area of interest.

25. The method of claim 1, comprising using a relatively colorful area portion of the image relative to a relatively less colorful portion of the image to determine the area of interest.

26. A display system, wherein the display system is configured to receive an input signal including image data representative of an image for display and encoded metadata indicative of an area of interest within the image wherein the area of interest is less than the entire image, the display being capable of adjusting grey levels of the image and adjusting illumination of the display based on the area of interest, the display system comprising:

a passive display;

an adjustable illumination source to illuminate to the passive display and cooperate with the passive display to display images;

a decoder configured to decode the encoded metadata to determine the area of interest within the image, the area of interest being represented by area of interest image data; and

a display controller operatively coupled to the passive display and the illumination source and configured to;

determine a range of grey levels and a brightness for the area of interest image data;

determine a display profile for the image based on the area of interest image data, the display profile comprising information for stretching the determined range of grey levels for the area of interest represented by the area of interest image data and illumination adjustment information for the area of interest;

apply the display profile to the entire image represented by the image data; and

control the passive display and the illumination source to simultaneously stretch the range of grey levels of the image and adjust illumination of the display in real time to display the image based on the applied display profile.