Display device and controlling method

• US 9,489,043 B2
• Filed: 01/05/2015
• Issued: 11/08/2016
• Est. Priority Date: 09/15/2009
• Status: Active Grant

• Current Assignee: Saturn Licensing LLC (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Iida, Yuuichi, Hayashi, Shinichi, Oi, Junji, Sakai, Yusuke, Sakuma, Daijiro, Tsurumi, Shingo
• Primary Examiner(s): Cheng, Joe H
• Application Number:
  US14/589,107
• Publication Number:
  US 20150185830A1
• Time in Patent Office: 673 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06V 40/178 estimating age from face image; using age information for improving recognition
• CPC Class Codes: G09G 2320/028 by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/440263 by altering the spatial resolution, e.g. for displaying on a connected PDA
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 5/64 Constructional details of receivers, e.g. cabinets or dust covers furniture aspects of television cabinets A47B81/06
• CPC Class Codes: H04N 9/64 Circuits for processing colour signals H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84
• CPC Class Codes: H04S 7/301 Automatic calibration of stereophonic sound system, e.g. with test microphone
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

An image display device and controlling method capable of optimizing a state of the image display device for a user at a desired position. The display device includes: an imaging section that takes an image of a predetermined range of a dynamic image with respect to an image display direction; an image analyzing section that analyzes the dynamic image taken by the imaging section and calculates a position of a user; a system optimization processing section that calculates system control information for optimizing a system based on the position of the user calculated by the image analyzing section; and a system controlling section that optimizes the system based on the system control information calculated by the system optimization processing section.

Claims

1. An information processing device, comprising:

a sensor that detects a user within a detectable range from the sensor; and

processing circuitry that

detects a face of the user based on image data captured by the sensor;

calculates system control information for optimizing an output of a display system based on a respective position of the user detected by the sensor;

analyzes the face of the user to determine an age of the user;

calculates a correction coefficient to correct the system control information according to the age of the user;

corrects the system control information based on the correction coefficient; and

optimizes the output of the display system based on the corrected system control information.

2. The information processing device according to claim 1, wherein the processing circuitry calculates the system control information to optimize a sound output of the display system based on the respective position of the user detected by the sensor.

3. The information processing device according to claim 2, wherein the processing circuitry calculates the system control information to optimize a volume balance of the sound output from an audio output of the display system based on the respective position of the user detected by the sensor.

4. The information processing device according to claim 2, wherein the processing circuitry calculates the system control information to adjust an output direction of the sound output of the display system based on the respective position of the user detected by the sensor.

5. The information processing device according to claim 1, wherein

the sensor detects a plurality of users within the detectable range from the sensor, and

the processing circuitry calculates the system control information to optimize the output of the display system based on respective positions of each of the plurality of users detected by the sensor.

6. The information processing device according to claim 1, wherein the processing circuitry calculates the system control information to optimize an image property of the output of the display system based on the respective position of the user detected by the sensor.

7. The information processing device according to claim 1, wherein the processing circuitry calculates the system control information to optimize a display content that is output by the display system based on the respective position of the user detected by the sensor.

8. The information processing device according to claim 1, wherein

the processing circuitry calculates the system control information to modify a display direction of the display system based on the respective position of the user detected by the sensor, and

the display system modifies the display direction of the display system according to the system control information.

9. The information processing device according to claim 1, wherein the processing circuitry further

calculates a position of the user according the face of the user, and

calculates the system control information for optimizing the output of the display system based on calculated position of the user.

10. The information processing device according to claim 1, wherein the processing circuitry, to correct the system control information based on the correction coefficient, adjusts a size of the output of the display system.

11. The information processing device according to claim 1, wherein the processing circuitry, to correct the system control information based on the correction coefficient, adjusts a brightness of the output of the display system.

12. The information processing device according to claim 1, wherein the processing circuitry further

calculates the system control information to optimize a sound output of the display system based on the respective position of the user detected by the sensor, and

adjusts a volume of the sound output of the display system to correct the system control information based on the correction coefficient.

13. The information processing device according to claim 1, wherein

the output of the display system includes a graphical user interface, and

the processing circuitry, to correct the system control information based on the correction coefficient, adjusts a position of the graphical user interface output by the display system.

14. The information processing device according to claim 1, wherein

the output of the display system includes a graphical user interface, and

the processing circuitry, to correct the system control information based on the correction coefficient, adjusts a brightness of the graphical user interface output by the display system.

15. The information processing device according to claim 1, wherein the processing circuitry sets a time constant based on the respective position of the user.

16. A controlling method, comprising:

detecting, by a sensor, a user within a detectable range from the sensor;

detecting a face of the user based on image data captured by the sensor;

calculating, by processing circuitry, system control information to optimize an output of a display system based on a respective position of the user detected by the sensor;

analyzing the face of the user to determine an age of the user;

calculating a correction coefficient to correct the system control information according to the age of the user;

correcting, by the processing circuitry, the system control information based on the correction coefficient; and

optimizing, by the processing circuitry, the output of the display system based on the corrected system control information.

17. The controlling method according to claim 16, further comprising:

setting, by the processing circuitry, a time constant based on the respective position of the user.

18. A non-transitory computer readable medium storing computer readable instructions that, when executed by a processor, cause the processor to:

control a sensor to detect a user within a detectable range from the sensor;

detect a face of the user based on image data captured by the sensor;

calculate system control information to optimize an output of a display system based on a respective position of the user detected by the sensor;

analyze the face of the user to determine an age of the user;

calculate a correction coefficient to correct the system control information according to the age of the user;

correct the system control information based on the correction coefficient; and

optimize the output of the display system based on the corrected system control information.