INTERSECTION SITUATION RECOGNITION SYSTEM

• US 20110141282A1
• Filed: 02/22/2011
• Published: 06/16/2011
• Est. Priority Date: 08/26/2008
• Status: Abandoned Application

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Takahashi, Kenji, NOTSU, Takuma, Ogawa, Masahiro
• Application Number:
  US13/032,306
• Publication Number:
  US 20110141282A1
• Time in Patent Office: Days
• US Class Current: 348/149
• CPC Class Codes: G08G 1/04 using optical or ultrasonic detectors
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

An image pickup device that picks up an image of a direction not visible from a vehicle that is about to enter an intersection, and transmits the picked-up image to the vehicle is installed in the vicinity of a blind intersection. In addition, an in-vehicle device that receives the image from the image pickup device, and displays the image on a display device is mounted in the vehicle. The in-vehicle device retrieves an image pickup device identification number of an image pickup device installed at the intersection that the vehicle is about to enter and transmits the retrieved image pickup device identification number to the image pickup device and, only when an image pickup device identification number received from the image pickup device together with an intersection image and the retrieved image pickup device identification number match with each other, the in-vehicle device displays the received intersection image.

Claims

1. An intersection situation recognition system comprising:

an image pickup device installed in a vicinity of an intersection, and for picking up an image of a direction not visible from a vehicle that is about to enter the intersection and transmitting the picked-up image to the vehicle that is about to enter the intersection; and

an in-vehicle device mounted in the vehicle that is about to enter the intersection, and for receiving and displaying the image from the image pickup device installed in the vicinity of the intersection, wherein

the in-vehicle device has;

a vehicle position detection unit for detecting a position of the vehicle in which the in-vehicle device is mounted and a running direction thereof;

an image pickup device retrieval unit for determining the intersection that the vehicle is about to enter from the position of the vehicle and the running direction thereof detected by the vehicle position detection unit, and retrieving an image pickup device identification number in correspondence to the image pickup device installed in the vicinity of the determined intersection;

an in-vehicle device-side transmission unit for transmitting the image pickup device identification number retrieved by the image pickup device retrieval unit to the image pickup device installed in the vicinity of the intersection;

an in-vehicle device-side reception unit for receiving the image and an image pickup device identification number transmitted from the image pickup device installed in the vicinity of the intersection;

an in-vehicle device-side identification number comparison unit for comparing the image pickup device identification number received by the in-vehicle device-side reception unit with the image pickup device identification number retrieved by the image pickup device retrieval unit, and detecting a match between the image pickup device identification numbers; and

a display device for displaying the image received from the image pickup device in correspondence to the image pickup device identification numbers between which the match is detected by the in-vehicle device-side identification number comparison unit, and

the image pickup device has;

an image pickup device identification number setting unit for setting the unique image pickup device identification number;

an image pickup unit for picking up an image of an intersection situation;

an image pickup device-side reception unit for receiving the image pickup device identification number transmitted from the in-vehicle device mounted in the vehicle that is about to enter the intersection;

an image pickup device-side identification number comparison unit for comparing the image pickup device identification number received by the image pickup device-side reception unit with the unique image pickup device identification number set in the image pickup device, and detecting a match between the image pickup device identification numbers;

a transmission judgment unit for judging whether or not transmission is permitted in accordance with a result of the match detection by the image pickup device-side identification number comparison unit; and

an image pickup device-side transmission unit for transmitting the image picked up by the image pickup unit and the unique image pickup device identification number to the in-vehicle device mounted in the vehicle that is about to enter the intersection when the image pickup device identification numbers match with each other and the transmission judgment unit judges that the transmission is permitted.

2. The intersection situation recognition system according to claim 1, wherein the image pickup device retrieval unit pre-records positional information, an image pickup direction, and the image pickup device identification number of the image pickup device in association with each other.

3. The intersection situation recognition system according to claim 1, wherein

the image pickup device has a transmission unit for transmitting image pickup device installation information including positional information, an image pickup direction, and the image pickup device identification number of the image pickup device to a surrounding area, and

the in-vehicle device has an image pickup device installation information reception unit for receiving the image pickup device installation information including the positional information, the image pickup direction, and the image pickup device identification information of the image pickup device.

4. The intersection situation recognition system according to claim 3, wherein the image pickup device retrieval unit records the positional information, the image pickup direction, and the image pickup device identification number of the image pickup device received by the image pickup device installation information reception unit in association with each other.

5. The intersection situation recognition system according to claim 1, wherein

the in-vehicle device has a priority judgment unit for assigning priorities to a plurality of image pickup devices based on an image pickup direction of the plurality of image pickup devices and the running direction of the vehicle in which the in-vehicle device is mounted in a state where the plurality of image pickup devices are installed at the intersection that the vehicle is about to enter,

the in-vehicle device-side transmission unit transmits the priorities of the plurality of image pickup devices assigned by the priority judgment unit in association with the image pickup device identification number,

the image pickup device-side reception unit receives the priorities of the image pickup devices from the in-vehicle device mounted in the vehicle that is about to enter the intersection, and

the image pickup device further has an image quality determination unit for determining an image quality of the image to be transmitted to the in-vehicle device mounted in the vehicle that is about to enter the intersection in accordance with the priorities of the image pickup devices received by the image pickup device-side reception unit, and an image processing unit for performing image processing on the image picked up by the image pickup unit in accordance with the image quality determined in the image quality determination unit.

6. The intersection situation recognition system according to claim 5, wherein the priority judgment unit assigns the priorities in accordance with route guidance of a route guidance device mounted in the vehicle in which the in-vehicle device is mounted.

7. The intersection situation recognition system according to claim 5, wherein the priority judgment unit assigns the priorities in accordance with a direction of a direction indicator of the vehicle in which the in-vehicle device is mounted.

8. The intersection situation recognition system according to claim 1, wherein

the in-vehicle device has an in-vehicle device identification number setting unit for setting a unique in-vehicle device identification number,

the in-vehicle device-side transmission unit transmits the unique in-vehicle device identification number to the image pickup device installed in the vicinity of the intersection,

the image pickup device-side reception unit receives the in-vehicle device identification number transmitted from the in-vehicle device mounted in the vehicle that is about to enter the intersection,

the image pickup device-side transmission unit transmits the in-vehicle device identification number to the in-vehicle device mounted in the vehicle that is about to enter the intersection,

the in-vehicle device-side reception unit receives the in-vehicle device identification number transmitted from the image pickup device installed in the vicinity of the intersection,

the in-vehicle device-side identification number comparison unit compares the in-vehicle device identification number received by the in-vehicle device-side reception unit with the in-vehicle device identification number unique to the in-vehicle device, and detects a match between the in-vehicle device identification numbers, and

the display device displays the image received from the image pickup device in correspondence to the image pickup device identification numbers between which the match is detected by the in-vehicle device-side identification number comparison unit when the match between the in-vehicle device identification number received by the in-vehicle device-side reception unit and the in-vehicle device identification number unique to the in-vehicle device is detected by the in-vehicle device-side identification number comparison unit.

9. The intersection situation recognition system according to claim 1, wherein the display device displays the received image on an entire screen.

10. The intersection situation recognition system according to claim 1, wherein the display device divides a screen, and displays the received image on a part of the screen and displays another image on a remaining portion of the screen simultaneously with the received image.

11. The intersection situation recognition system according to claim 10, wherein the another image is an image showing route guidance.

12. The intersection situation recognition system according to claim 1, wherein the display device displays route guidance on a screen, and displays the received image on the screen in overlapping relation on the route guidance.

13. The intersection situation recognition system according to claim 1, wherein

the in-vehicle device requests the image pickup device installed in the vicinity of the intersection to pick up an image of the intersection when the vehicle in which the in-vehicle device is mounted is about to enter the intersection, and

the image pickup device performs image pickup only when the request for the image pickup is made from the in-vehicle device mounted in the vehicle that is about to enter the intersection.

14. The intersection situation recognition system according to claim 1, wherein the image pickup device has a transmission rate measurement unit for measuring a transmission rate between the image pickup device and the in-vehicle device, and performs at least one of a change of an image process content, a change of a bit rate of an image, and a change of an image size stepwise in accordance with the transmission rate as a measurement result by the transmission rate measurement unit.

15. An image pickup device installed in a vicinity of an intersection, and for picking up an image of a direction not visible from a vehicle that is about to enter the intersection and transmitting the picked-up image to the vehicle that is about to enter the intersection, comprising:

an image pickup device identification number setting unit for setting a unique image pickup device identification number;

an image pickup unit for picking up an image of an intersection situation;

an image pickup device-side reception unit for receiving an image pickup device identification number transmitted from an in-vehicle device mounted in the vehicle that is about to enter the intersection;

an image pickup device-side identification number comparison unit for comparing the image pickup device identification number received by the image pickup device-side reception unit with the unique image pickup device identification number set in the image pickup device, and detecting a match between the image pickup device identification numbers;

a transmission judgment unit for judging whether or not transmission is permitted in accordance with a result of the match detection by the image pickup device-side identification number comparison unit; and

an image pickup device-side transmission unit for transmitting the image picked up by the image pickup unit and the unique image pickup device identification number to the in-vehicle device mounted in the vehicle that is about to enter the intersection when the image pickup device identification numbers match with each other and the transmission judgment unit judges that the transmission is permitted.

16. The image pickup device according to claim 15, wherein

the image pickup device-side reception unit receives an in-vehicle device identification number transmitted from the in-vehicle device mounted in the vehicle that is about to enter the intersection, and

the image pickup device-side transmission unit transmits the in-vehicle device identification number to the in-vehicle device mounted in the vehicle that is about to enter the intersection.

17. The image pickup device according to claim 15, comprising:

a transmission unit for transmitting image pickup device installation information including positional information, an image pickup direction, and the image pickup device identification number of the image pickup device to a surrounding area.

18. The image pickup device according to claim 15, wherein

the image pickup device-side reception unit receives a priority of the image pickup device from the in-vehicle device mounted in the vehicle that is about to enter the intersection,

the image pickup device further comprising:

an image quality determination unit for determining an image quality of the image to be transmitted to the in-vehicle device mounted in the vehicle that is about to enter the intersection in accordance with the priority of the image pickup device received by the image pickup device-side reception unit; and

an image processing unit for performing image processing on the image picked up by the image pickup unit in accordance with the image quality determined by the image quality determination unit.

19. The image pickup device according to claim 15, wherein the image pickup device performs image pickup only when a request for the image pickup is made from the in-vehicle device mounted in the vehicle that is about to enter the intersection.

20. The image pickup device according to claim 15, further comprising:

a transmission rate measurement unit for measuring a transmission rate between the image pickup device and the in-vehicle device, wherein

at least one of a change of an image process content, a change of a bit rate of an image, and a change of an image size is performed stepwise in accordance with the transmission rate as a measurement result by the transmission rate measurement unit.

21. An in-vehicle device mounted in a vehicle that is about to enter an intersection, and for receiving and displaying an image from an image pickup device installed in a vicinity of the intersection, comprising:

a vehicle position detection unit for detecting a position of the vehicle in which the in-vehicle device is mounted and a running direction thereof;

an image pickup device retrieval unit for determining the intersection that the vehicle is about to enter from the position of the vehicle and the running direction thereof, and retrieving an image pickup device identification number in correspondence to the image pickup device installed in the vicinity of the determined intersection;

an in-vehicle device-side transmission unit for transmitting the image pickup device identification number retrieved by the image pickup device retrieval unit to the image pickup device installed in the vicinity of the intersection;

an in-vehicle device-side reception unit for receiving the image and an image pickup device identification number transmitted from the image pickup device installed in the vicinity of the intersection;

an in-vehicle device-side identification number comparison unit for comparing the image pickup device identification number received by the in-vehicle device-side reception unit with the image pickup device identification number retrieved by the image pickup device retrieval unit, and detecting a match between the image pickup device identification numbers; and

a display device for displaying the image received from the image pickup device in correspondence to the image pickup device identification numbers between which the match is detected by the in-vehicle device-side identification number comparison unit.

22. The in-vehicle device according to claim 21, wherein the image pickup device retrieval unit pre-records positional information, an image pickup direction, and the image pickup device identification number of the image pickup device in association with each other.

23. The in-vehicle device according to claim 21, further comprising:

an image pickup device installation information reception unit for receiving image pickup device installation information including positional information, an image pickup direction, and the image pickup device identification number of the image pickup device.

24. The in-vehicle device according to claim 23, wherein the image pickup device retrieval unit records the positional information, the image pickup direction, and the image pickup device identification number of the image pickup device received by the image pickup device installation information reception unit in association with each other.

25. The in-vehicle device according to claim 22, further comprising:

a priority judgment unit for assigning priorities to a plurality of image pickup devices based on the image pickup direction of the plurality of image pickup devices and the running direction of the vehicle in which the in-vehicle device is mounted in a state where the plurality of image pickup devices are installed at the intersection that the vehicle is about to enter, wherein

the in-vehicle device-side transmission unit transmits the priorities of the plurality of image pickup devices assigned by the priority judgment unit in association with the image pickup device identification number.

26. The in-vehicle device according to claim 25, wherein the priority judgment unit assigns the priorities in accordance with route guidance of a route guidance device mounted in the vehicle in which the in-vehicle device is mounted.

27. The in-vehicle device according to claim 25, wherein the priority judgment unit assigns the priorities in accordance with a direction of a direction indicator of the vehicle in which the in-vehicle device is mounted.

28. The in-vehicle device according to claim 21, further comprising:

an in-vehicle device identification number setting unit for setting a unique in-vehicle device identification number, wherein

the in-vehicle device-side transmission unit transmits the unique in-vehicle device identification number to the image pickup device installed in the vicinity of the intersection,

the in-vehicle device-side reception unit receives the in-vehicle device identification number transmitted from the image pickup device installed in the vicinity of the intersection,

the in-vehicle device-side identification number comparison unit compares the in-vehicle device identification number received by the in-vehicle device-side reception unit with the in-vehicle device identification number unique to the in-vehicle device, and detects a match between the in-vehicle device identification numbers, and

the display device displays the image received from the image pickup device in correspondence to the image pickup device identification numbers between which the match is detected by the in-vehicle device-side identification number comparison unit when the match between the in-vehicle device identification number received by the in-vehicle device-side reception unit and the in-vehicle device identification number unique to the in-vehicle device is detected by the in-vehicle device-side identification number comparison unit.

29. The in-vehicle device according to claim 21, wherein the display device displays the received image on an entire screen.

30. The in-vehicle device according to claim 21, wherein the display device divides a screen, and displays the received image on a part of the screen and displays another image on a remaining portion of the screen simultaneously with the received image.

31. The in-vehicle device according to claim 30, wherein the another image is an image showing route guidance.

32. The in-vehicle device according to claim 21, wherein the display device displays route guidance on a screen, and displays the received image on the screen in overlapping relation on the route guidance.

33. The in-vehicle device according to claim 21, wherein the in-vehicle device requests the image pickup device installed in the vicinity of the intersection to pick up an image of the intersection when the vehicle in which the in-vehicle device is mounted is about to enter the intersection.