Signal processing device, signal processing method, and monitoring system

• US 10,632,917 B2
• Filed: 06/23/2015
• Issued: 04/28/2020
• Est. Priority Date: 08/12/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Oba, Eiji
• Primary Examiner(s): Rahman, Mohammad J
• Application Number:
  US15/323,764
• Publication Number:
  US 20170166131A1
• Time in Patent Office: 1,771 Days
• Field of Search: None
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/002 specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like integrated in the windows B60R1/001; combined with rear-view mirrors B60R1/08
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 5/268 Signal distribution or switching
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

In accordance with driving information that is obtained by a driving situation detecting sensor 13 and is related to the driving situation of a vehicle, a display control unit 20 sets the image area to be presented to the driver DR of the vehicle from an image obtained by a peripheral area imaging unit 11 imaging a peripheral area around the vehicle, and, in accordance with the driving situation, controls the visual recognition range in the peripheral area the driver DR can visually recognize from the image presented by a display unit 50 via a mirror 55. When the driving situation is such that the orientation of a cabin differs from the orientation of a trailer portion, for example, the image area to be presented is set so that the outer side of the trailer portion is included in the visual recognition range even though the orientation of the cabin differs from the orientation of the trailer portion. Thus, a desired peripheral area around the vehicle can be readily viewed.

Claims

1. A signal processing device comprising:

circuitry configured to

set an image area to be presented to a driver of a vehicle from an image obtained by imaging a peripheral area around the vehicle in accordance with driving information related to a driving situation of the vehicle;

make a determination of whether the driver has turned their head by comparing a recognition result with a reference value; and

adjust a visual recognition range in the peripheral area when the determination indicates that the driver has turned their head,

wherein the image area presented to the driver is shown on a display and reflected in a mirror for viewing by the driver, and the mirror is positioned further from the driver than the display.

2. The signal processing device according to claim 1, wherein the circuitry is further configured to control the visual recognition range to move to an outer side of the vehicle, in accordance with driving information related to a traveling direction of the vehicle.

3. The signal processing device according to claim 1, wherein

the image obtained by imaging the peripheral area around the vehicle is an image captured from a predetermined position of the vehicle or images captured from a plurality of predetermined positions that differ from each other in a traveling direction, and

the circuitry is further configured to set the image area to be presented from the one or more captured images in accordance with the driving information.

4. The signal processing device according to claim 3, wherein

the vehicle is formed by connecting a trailer portion to a cabin, and

the image captured from the predetermined position of the vehicle is an image formed by imaging the peripheral area around the vehicle from a predetermined position of the cabin, and the images captured from the predetermined positions that differ from each other in the traveling direction of the vehicle are images formed by imaging the peripheral area around the vehicle from respective predetermined positions of the cabin and the trailer portion.

5. The signal processing device according to claim 4, wherein, when a driving situation is such that an orientation of the cabin differs from an orientation of the trailer portion in accordance with the driving information, the circuitry is further configured to set the image area to be presented, with an outer side of the trailer portion being included in the visual recognition range.

6. The signal processing device according to claim 1, wherein the driving information includes at least one piece of information among vehicle speed information about the vehicle, information indicating a steering state, gear position information, a direction indicator setting state, a bend angle of a trailer portion relative to a cabin in a case where the vehicle is formed by connecting the cabin to the trailer portion, information indicating a connection state of the trailer portion, and current position information.

9. The signal processing device according to claim 2, wherein the traveling direction of the vehicle includes turning right or left at an acute angle or moving backward at another acute angle.

10. The signal processing device according to claim 1, wherein the circuitry is further configured to adjust the visual recognition range based on a head position of the driver.

11. The signal processing device according to claim 1, wherein the circuitry is further configured to set a width of the image area based on the visual recognition range in the peripheral area.

12. The signal processing device according to claim 1, wherein the circuitry is further configured to expand the visual recognition range after detecting a head turning motion of the driver.

13. The signal processing device according to claim 1, wherein the visual recognition range is adjusted by magnifying the peripheral area in the image.

14. The signal processing device according to claim 1, wherein the visual recognition range is adjusted by magnifying the peripheral area in the image.

15. The signal processing device according to claim 1, wherein the display and the mirror are positioned such that a visual recognition distance from the driver is 1.1 m or longer.

16. The signal processing device according to claim 1, wherein the circuitry is further configured to enter a high-speed detection mode after detecting a head turning motion of the driver.

17. The signal processing device according to claim 1, wherein the circuitry is further configured to detect an eye movement of the driver and to estimate a line of site of the driver based on an orientation of the driver'"'"'s head and the eye movement.

18. The signal processing device according to claim 1, wherein the circuitry is further configured to adjust the visual recognition range in the peripheral area in response to detecting an acceleration of the turning of the driver'"'"'s head.

7. A signal processing method comprising:

setting an image area to be presented to a driver of a vehicle from an image obtained by circuitry of an signal processing device imaging a peripheral area around the vehicle in accordance with driving information related to a driving situation of the vehicle; and

making a determination of whether the driver has turned their head by comparing a recognition result with a reference value; and

adjusting a visual recognition range in the peripheral area when the determination indicates that the driver has turned their head, wherein the image area presented to the driver is shown on a display and reflected in a mirror for viewing by the driver, and the mirror is positioned further from the driver than the display.

8. A monitoring system comprising:

a display;

a mirror;

circuitry configured to

image a peripheral area around a vehicle;

acquire driving information about a driving situation of the vehicle;

set an image area to be presented to a driver of the vehicle from the image of the peripheral area around the vehicle in accordance with the driving information;

make a determination of whether the driver has turned their head by comparing a recognition result with a reference value; and

adjust a visual recognition range in the peripheral area when the determination indicates that the driver has turned their head,

wherein the image area presented to the driver is shown on the display and reflected in the mirror for viewing by the driver, and the mirror is positioned further from the driver than the display.