Display control apparatus, computer-implemented method, storage medium, and projection apparatus

• US 9,639,990 B2
• Filed: 09/29/2014
• Issued: 05/02/2017
• Est. Priority Date: 10/03/2013
• Status: Active Grant

• Current Assignee: Panasonic Automotive Systems Company of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Mochizuki, Makoto, Kobayashi, Shigeru, Emura, Koichi
• Primary Examiner(s): Merouan, Abderrahim
• Assistant Examiner(s): Flora, Nurun N
• Application Number:
  US14/499,608
• Publication Number:
  US 20150097866A1
• Time in Patent Office: 946 Days
• Field of Search: None
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/0421 Horizontal resolution change
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP
• CPC Class Codes: G09G 5/38 with means for controlling the display position
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

In a display control apparatus configured to control image data displayed on a predetermined display medium, an information acquisition unit acquires a first information associated with the predetermined matter at a first time and acquire a second information associated with the predetermined matter at a second time after the first time. A determination unit judges whether there is a predetermined change between the first information and the second information. A control unit controls the image data such that in a case where a predetermined change is detected, at least one of parameters including a location, a size, and a shape of a restricted area, in which the displaying of display information including in the image data is limited, is changed so as to achieve the parameter defined in relation to the second information.

Claims

1. A display control apparatus associated with a vehicle that controls image data displayed on a predetermined display medium to an occupant of the vehicle, comprising:

a memory that stores instructions;

a processor that, when executing the instructions stored in the memory, performs operations including

acquiring a first information at a first time and acquiring a second information at a second time after the first time;

judging whether there is a predetermined change between the first information associated with the predetermined matter and the second information;

controlling the image data such that in a case where the predetermined change is detected, a first restricted area and a second restricted area where the displaying of display information included in the image data is limited on the display medium, the first restricted area defined in relation to the first information is changed to the second restricted area defined in relation to the second information, the second restricted area is different from the first restricted area in terms of at least one of a location, a size, a number, and a shape; and

outputting the controlled image data to the predetermined display medium for viewing by the occupant of the vehicle,

wherein the display information is information belonging to one of a first type or a second type and

in a case where a change of the first restricted area causes the display information not to be displayed within the second restricted area, the processor controls the image data such that in a case where the display information is information belonging to the first type, the display information is displayed in an allowed area located outside the second restricted area, while in a case where the display information is information belonging to the second type, the location where the display information is displayed is maintained.

2. The display control apparatus according to claim 1,

wherein in a case where the change of the first restricted area causes the display information to be displayed within the second restricted area, the processor controls the image data such that the display information is displayed in an allowed area located outside the second restricted area.

3. The display control apparatus according to claim 2,

wherein in a case where after the second information is acquired, a third information with the same content as the content of the first information is acquired, the processor controls the image data such that the display information displayed in the allowed area located outside the second restricted area is returned to a location where the first information was originally displayed.

4. The display control apparatus according to claim 1,

wherein in a case where the change of the first restricted area causes the display information to be displayed within the second restricted area, the processor controls the image data such that the display information is deleted from the display medium.

5. The display control apparatus according to claim 1,

wherein the processor controls the image data such that an outline of the restricted area is displayed with one of a solid line, a dashed-line, a broken line, a chain line, and a wavy line on the display medium.

6. The display control apparatus according to claim 1,

wherein in a case where the display information is information belonging to the second type, the processor controls the image data such that at least one of color, transparency, and luminance of the display information is changed.

7. The display control apparatus according to claim 1,

wherein in a case where the predetermined change is detected, the processor controls the image data such that the first restricted area is divided into a plurality of sub-areas.

8. A method for displaying control image data associated with a vehicle on a predetermined display medium for viewing by an occupant of the vehicle, the method comprising:

acquiring a first information at a first time and a second information at a second time after the first time;

making a judgment whether there is a predetermined change between the first information and the second information;

controlling the image data such that in a case where the predetermined change is detected, a first restricted area where the displaying of display information included in the image data is limited on the display medium, the first restricted area being defined in relation to the first information is changed to a second restricted area defined in relation to the second information, the second restricted area is different from the first restricted area in terms of at least one of a location, a size, a number, and a shape; and

outputting the controlled image data to the predetermined display medium for viewing by the occupant of the vehicle,

wherein the display information is information belonging to one of a first type or a second type, and in a case where a change of the first restricted area causes the display information not to be displayed within the second restricted area, controlling the image data such that in a case where the display information is information belonging to the first type, the display information is displayed in an allowed area located outside the second restricted area, while in a case where the display information is information belonging to the second type, the location where the display information is displayed is maintained.

9. A display control apparatus in a display system associated with a vehicle, including a sensor that detects a predetermined state of at least one of the vehicle and a driver, and a display that generates a predetermined image based on a first notification information, the display control apparatus comprising:

a memory that stores instructions;

a processor that, when executing the instructions stored in the memory, performs operations including

controlling the display such that in a case where the sensor detects a first predetermined state at a first time, a first predetermined image for representing the first notification information is generated and outputted to a display medium for viewing by the driver such that the first predetermined image is displayed in an area outside the first restricted area, wherein the first restricted area is an area defined in advance in relation to the first predetermined state; and

making a judgment such that in a case where the sensor detects a second predetermined state different from the first predetermined state at a second time later than the first time, the processor judges whether there is a predetermined change between the first predetermined state and the second predetermined state,

wherein in a case where the processor judges that there is the predetermined change, the processor controls the display such that a second predetermined image for representing the first notification information is generated and is outputted to the display medium for viewing by the driver such that the second predetermined image is displayed in an area outside the second restricted area on the display medium, wherein the second restricted area is an area defined in advance in relation to the second predetermined state, and the second restricted area is different from the first restricted area in terms of at least one of a location, a size, a number, and a shape, and

wherein the display information is information belonging to one of a first type or a second type, and in a case where a change of the first restricted area causes the display information not to be displayed within the second restricted area, controlling the image data such that in a case where the display information is information belonging to the first type, the display information is displayed in an allowed area located outside the second restricted area, while in a case where the display information is information belonging to the second type, the location where the display information is displayed is maintained.

10. A projection apparatus, comprising:

the display control apparatus according to claim 9, and

the display.

11. A method for a display system associated with a vehicle including a processor that acquires a first notification information to be notified to a driver of the vehicle, a sensor that detects a predetermined state of at least one of the vehicle and the driver, and a display that generates a predetermined image based on the first notification information acquired via the processor, the method comprising:

controlling the display such that in a case where the sensor detects a first predetermined state at a first time, a first predetermined image for representing the first notification information is generated and outputted to a display medium for viewing by the driver such that the first predetermined image is displayed in an area outside the first restricted area, wherein the first restricted area is an area defined in advance in relation to the first predetermined state;

making a judgment such that in a case where the sensor detects a second predetermined state different from the first predetermined state at a second time later than the first time, the judgment is made as to whether there is a predetermined change between the first predetermined state and the second predetermined state; and

controlling the display such that in a case where it is judged that there is the predetermined change, a second predetermined image for representing the first notification information is generated and is outputted to the display medium for viewing by the driver such that the second predetermined image is displayed in an area outside the second restricted area on the display medium,

wherein the second restricted area is an area defined in advance in relation to the second predetermined state, and the second restricted area is different from the first restricted area in terms of at least one of a location, a size, a number, and a shape,

wherein further making a judgment such that in a case where the sensor detects a third predetermined state different from the second predetermined state at a third time later than the second time, the judgment is made as to whether there is a predetermined change between the second predetermined state and the third predetermined state; and

controlling the display such that in a case where it is judged that there is the predetermined change, a third predetermined image for representing the first notification information is generated and is outputted to the display medium for viewing by the driver such that the third predetermined image is displayed in an area outside a third restricted area on the display medium,

wherein the third restricted area is an area defined in advance in relation to the third predetermined state, and the third restricted area is different from the first restricted area in terms of at least one of a location, a size, a number, and a shape.

12. The method according to claim 11,

wherein controlling the display such that in a case where the detection of the second predetermined state by the sensor causes the first predetermined image for representing the first notification information displayed in the area outside the first restricted area to be included within the second restricted area, a second predetermined image for representing the first notification information is displayed on the display medium such that the image representing the first notification information is moved from the inside of the second restricted area to an area outside the second restricted area.

13. The method according to claim 11, further comprising:

controlling the display such that in a case where it is judged that there is the predetermined change in a state in which the location where image representing the first notification information is displayed on the display medium at the first time is in an area outside the third restricted area, a third predetermined image for representing the first notification information is generated and outputted to the display medium such that the third predetermined image is displayed at the location where the image representing the first notification information was displayed at the first time.

14. The method according to claim 11,

wherein the outline of the restricted area is indicated with a solid line, a dotted line, a broken line, a chain line, or a wavy line, on the display medium.

15. The method according to claim 11, further comprising:

controlling the display such that in a case where the size of the second restricted area is substantially equal to the size of the display medium, the image representing the first notification information is deleted from the display medium.

16. A method for a display system associated with a vehicle including a processor that acquires a first notification information to be notified to a driver of the vehicle, a sensor that detects a predetermined state of at least one of the vehicle and the driver, and a display that generates a predetermined image based on the first notification information acquired via the processor, the method comprising:

controlling the display such that in a case where the sensor detects a first predetermined state at a first time, a first predetermined image for representing the first notification information is generated and outputted to a display medium for viewing by the driver such that the first predetermined image is displayed in an area outside the first restricted area, wherein the first restricted area is an area defined in advance in relation to the first predetermined state;

making a judgment such that in a case where the sensor detects a second predetermined state different from the first predetermined state at a second time later than the first time, the judgment is made as to whether there is a predetermined change between the first predetermined state and the second predetermined state; and

controlling the display such that in a case where it is judged that there is the predetermined change, a second predetermined image for representing the first notification information is generated and is outputted to the display medium for viewing by the driver such that the second predetermined image is displayed in an area outside the second restricted area on the display medium,

wherein the second restricted area is an area defined in advance in relation to the second predetermined state, and the second restricted area is different from the first restricted area in terms of at least one of a location, a size, a number, and a shape; and

controlling the display such that in a case where the processor acquires the first notification information and second notification information different from the first notification information, an image indicating the first notification information in an area outside the first restricted area and a third predetermined image representing an image indicating the second notification information are generated and outputted to the display medium for viewing by the driver, and

in a state in which the image indicating the first notification information and the image indicating second notification information are displayed at the first time at a location included in the second restricted area, if it is judged that the predetermined change is detected, then a fourth predetermined image for representing an image indicating the first notification information and the image indicating the second notification information is generated and outputted to the display medium for viewing by the driver such that the image indicating the first notification information is displayed in an area outside the second restricted area and the image indicating the second notification information is displayed at the location where the image indicating the second notification information was displayed at the first time.

17. The method according to claim 16,

wherein the image indicating the second notification information of the fourth predetermined image is changed in terms of at least one of color, transparency, and luminance.

18. A method for a display system including a processor that acquires a first notification information to be notified to a driver of a vehicle, a sensor that detects a predetermined state of at least one of the vehicle and the driver, and a display that generates a predetermined image based on the first notification information acquired via the processor, the method comprising:

controlling the display such that in a case where the sensor detects a first predetermined state at a first time, a first predetermined image for representing the first notification information is generated and outputted to a display medium such that the first predetermined image is displayed in an area outside the first restricted area, wherein the first restricted area is an area defined in advance in relation to the first predetermined state;

making a judgment such that in a case where the sensor detects a second predetermined state different from the first predetermined state at a second time later than the first time, the judgment is made as to whether there is a predetermined change between the first predetermined state and the second predetermined state; and

controlling the display such that in a case where it is judged that there is the predetermined change, a second predetermined image for representing the first notification information is generated and is displayed on the display medium such that the second predetermined image is displayed in an area outside the second restricted area on the display medium,

wherein the second restricted area is an area defined in advance in relation to the second predetermined state, and the second restricted area is different from the first restricted area in terms of at least one of a location, a size, a number, and a shape,

wherein the predetermined state indicates one of automatic driving levels of the vehicle,

a plurality of automatic driving levels are prescribed from a level in which all operations necessary in driving are performed by a driver of the vehicle to a level in which automatic driving is performed without the driver of the vehicle having to perform any operation necessary in driving, and

the predetermined change between the first automatic driving level and the second automatic driving level is a change between one of the plurality of levels and another one of the plurality of levels.

19. A non-transitory, tangible computer-readable storage medium storing display control program to be executed by a computer in a display system associated with a vehicle, the display system including a processor that acquires a first notification information to be notified to a driver of the vehicle, a sensor that detects a predetermined state of at least one of the vehicle and the driver, and a display that generates a predetermined image based on the first notification information acquired via the processor, the display control program configured to cause the computer to execute a process, the process comprising:

controlling the display such that in a case where the sensor detects a first predetermined state at a first time, a first predetermined image for representing the first notification information is generated and outputted to a display medium for viewing by the driver such that the first predetermined image is displayed in an area outside the first restricted area, wherein the first restricted area is an area defined in advance in relation to the first predetermined state;

making a judgment such that in a case where the sensor detects a second predetermined state different from the first predetermined state at a second time later than the first time, the judgment is made as to whether there is a predetermined change between the first predetermined and the second predetermined state; and

controlling the display such that in a case where it is judged that there is the predetermined change, a second predetermined image for representing the first notification information is generated and is outputted to the display medium for viewing by the driver such that the second predetermined image is displayed in an area outside the second restricted area on the display medium,

wherein the second restricted area is an area defined in advance in relation to the second predetermined state, and the second restricted area is different from the first restricted area in terms of at least one of location, size, number, and shape, and

wherein the display information is information belonging to one of a first type or a second type, and in a case where a change of the first restricted area causes the display information not to be displayed within the second restricted area, controlling the image data such that in a case where the display information is information belonging to the first type, the display information is displayed in an allowed area located outside the second restricted area, while in a case where the display information is information belonging to the second type, the location where the display information is displayed is maintained.