Display Control Method and Display Control Device

• US 20180312110A1
• Filed: 10/22/2015
• Published: 11/01/2018
• Est. Priority Date: 10/22/2015
• Status: Active Grant

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Takae, Yasuhiko, Sunda, Takashi, Shino, Tatsuya
• Granted Patent: US 10,322,674 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 1/22 for viewing an area outside the vehicle, e.g. the exterior of the vehicle
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 21/00 Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks safety belts or body harnesses in vehicles B60R22/00; devices, apparatus or methods for life-saving in general A62B; safety devices for propulsion unit control specially adapted for, or arranged in, vehicles B60K28/00; seats constructed to protect the occupant from the effect of abnormal g-forces, e.g. crash or safety seats, B60N2/42; energy-absorbing arrangements for hand wheels for steering vehicles B62D1/11; energy-absorbing arrangements for vehicle steering columns B62D1/19; harnessing in aircraft B64D25/00
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/306 using a re-scaling of images
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/0112 from the vehicle, e.g. floating car data [FCD]
• CPC Class Codes: G08G 1/0133 for classifying traffic situation
• CPC Class Codes: G08G 1/04 using optical or ultrasonic detectors
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A display control method includes performing display control of detection information of an object detected by a detector including a camera. The detection information includes a first image based on a captured image captured by the camera and a second image based on an image rendered on the basis of a detection result of the detector. The display control method further includes switching and displaying the first image and the second image in accordance with a vehicle speed index of a vehicle.

Claims

1. A display control method comprising:

performing display control of detection information of an object detected by a detector including a camera, the detection information including a first image based on a captured image captured by the camera and a second image based on an image rendered on a basis of a detection result of the detector;

displaying the first image when a traveling speed of a vehicle is lower than a predetermined speed; and

displaying the second image when the traveling speed of the vehicle is not lower than the predetermined speed.

2. A display control method comprising:

performing display control of detection information of an object detected by a detector including a camera, the detection information including a first image based on a captured image captured by the camera and a second image based on an image rendered on a basis of a detection result of the detector;

displaying the first image when a vehicle speed index represents a vehicle speed lower than a predetermined speed, the vehicle speed index being any one of a traveling speed of a vehicle, a gear ratio of a transmission, a speed limit of a road on which the vehicle travels, a distance from the vehicle to the object, and a traveling scene of the vehicle, the traveling scene including a stop scene, a crawl scene, a bicycle parallel traveling scene, an urban traveling scene, a suburban traveling scene, and a high-speed cruising scene; and

displaying the second image when the vehicle speed index represents a traveling speed equal to or higher than the predetermined speed.

3. The display control method according to claim 2, wherein

the vehicle speed index is a gear ratio of a transmission,

the first image is displayed when the gear ratio is not lower than a predetermined value, and

the second image is displayed when the gear ratio is lower than the predetermined value.

4. The display control method according to claim 2, wherein

the vehicle speed index is a traveling speed of the vehicle,

the first image is displayed when the traveling speed is lower than a predetermined speed, and

the second image is displayed when the traveling speed is not lower than the predetermined speed.

5. The display control method according to claim 2, wherein

the vehicle speed index is a speed limit of a road on which the vehicle travels,

the first image is displayed when the speed limit is lower than a predetermined speed, and

the second image is displayed when the speed limit is not lower than the predetermined speed.

6. The display control method according to claim 2, wherein

the vehicle speed index is a distance from the vehicle to the object,

the first image is displayed when the distance is shorter than a predetermined distance, and

the second image is displayed when the distance is not shorter than the predetermined distance.

7. The display control method according to claim 2, wherein

the vehicle speed index is a traveling scene of the vehicle,

the traveling scene of the vehicle is determined on a basis of a traveling state of the vehicle, and

the first image and the second image are switched and displayed on a basis of the traveling scene of the vehicle.

8. The display control method according to claim 2, wherein

when the first image is displayed, a mask process is performed for an end part of the first image with a width in accordance with a traveling speed of the vehicle or the vehicle speed index.

9. The display control method according to claim 2, wherein when the first image is displayed, a bonnet image imitating a bonnet of the vehicle is superimposed on the first image.

10. The display control method according to claim 9, wherein

a size or a shape of the bonnet image to be superimposed on the first image is changed in accordance with a traveling speed of the vehicle or the vehicle speed index.

11. The display control method according to claim 2, wherein

the camera comprises a plurality of cameras, the captured image comprises a plurality of captured images, the captured images captured by the cameras are acquired, and the captured image used for generation of the first image is selected from among the captured images captured by the cameras.

12. The display control method according to claim 2, wherein

the object detected by the detector is displayed in an emphasized manner in the first image.

13. The display control method according to claim 2, wherein

the object comprises a plurality of objects detected by the detector, and when control of travel of the vehicle is performed with one or more targeted objects among the detected objects, the one or more targeted objects for the control are displayed in the first image in an emphasized manner in a display form different from that of the objects which are not targeted.

14. The display control method according to claim 2, wherein

when the first image is displayed, distance information that suggests a distance from the vehicle to the object is superimposed on the first image.

15. The display control method according to claim 2, wherein

the second image is an image based on an overview image in which a subject vehicle is viewed from above.

16. The display control method according to claim 15, wherein

when the second image is displayed, the second image is displayed with a different depression angle in accordance with the vehicle speed index.

17. The display control method according to claim 2, wherein

when the second image is displayed, the object detected by the detector is arranged in the second image.

18. The display control method according to claim 2, wherein

the object comprises a plurality of objects detected by the detector, and when control of travel of the vehicle is performed with one or more targeted objects among the detected objects, the one or more targeted objects for the control are displayed in the second image in an emphasized manner.

19. The display control method according to claim 2, wherein

when the second image is displayed, distance information that suggests a distance from the vehicle to the object is superimposed on the second image.

20. The display control method according to claim 2, wherein

when the first image and the second image are switched, a switching image representing transition from the first image to the second image or transition from the second image to the first image is displayed.

21. The display control method according to claim 20, wherein

a switching time between the first image and the second image is changed on a basis of acceleration of the vehicle.

22. A display control device for performing display control of detection information of an object detected by a detector including a camera, wherein

the detection information includes a first image based on a captured image captured by the camera and a second image based on an image rendered on a basis of a detection result of the detector,

the first image is displayed when a traveling speed of a vehicle is lower than a predetermined speed, and

the second image is displayed when the traveling speed of the vehicle is not lower than the predetermined speed.