In-vehicle apparatus

• US 9,199,607 B2
• Filed: 11/22/2011
• Issued: 12/01/2015
• Est. Priority Date: 12/06/2010
• Status: Active Grant

• Current Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Original Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Inventors: Ohta, Mitsuru, Sasaki, Yoshihiro
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): Rahman, Mohammad J
• Application Number:
  US13/302,487
• Publication Number:
  US 20120140073A1
• Time in Patent Office: 1,470 Days
• Field of Search: 348/148
• US Class Current: 1/1
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/50 characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 25/1012 Zone surveillance means, e.g. parking lots, truck depots

Abstract

An in-vehicle apparatus includes an image-capturing part that is installed on a vehicle and captures an image of a periphery of the vehicle, an image generator that generates a bird'"'"'s-eye image including the vehicle and the periphery of the vehicle viewed from a virtual viewpoint based on the image captured by the image-capturing part, and a transmitter that transmits the bird'"'"'s-eye image to a terminal. The image generator changes the virtual viewpoint based on a change request from the terminal and generates the bird'"'"'s-eye image viewed from the virtual viewpoint after changing the virtual viewpoint.

Claims

1. An in-vehicle apparatus that is installed in a vehicle and that wirelessly communicates with a mobile terminal, the in-vehicle apparatus comprising:

an image-capturing part that is installed on the vehicle and captures an image of a periphery of the vehicle;

an image generator that generates a first bird'"'"'s-eye image including the vehicle and the periphery of the vehicle viewed from a first virtual viewpoint based on the image captured by the image-capturing part;

a transmitter that wirelessly transmits the bird'"'"'s-eye image to the mobile terminal; and

a detector that detects a target approaching the vehicle, wherein;

based on a change request received from the mobile terminal, the image generator changes the first virtual viewpoint to a second virtual viewpoint and generates a second bird'"'"'s-eye image viewed from the second virtual viewpoint after changing from the first virtual viewpoint to the second virtual viewpoint,

when a signal indicating that an automatic follow-up is selected is received from the mobile terminal, the image-capturing part initiates an automatic follow-up that is free from user input, the automatic follow-up causes the image-capturing part to point at the target approaching the vehicle, and

the transmitter sends the first bird'"'"'s-eye image from the first virtual viewpoint and sends the second bird'"'"'s eye-image from the second virtual viewpoint based on the received change request, and sends a video when the signal indicating that the automatic follow-up is selected is received from the mobile terminal.

2. The in-vehicle apparatus of claim 1, further comprising:

a sensor that detects a target in the periphery of the vehicle, wherein the image generator starts generating the first bird'"'"'s-eye image when the sensor has detected the target in the periphery of the vehicle.

3. The in-vehicle apparatus of claim 1, wherein the transmitter transmits the image captured by the image-capturing part based on a transmit request from the mobile terminal.

4. The in-vehicle apparatus of claim 1, further comprising:

a second-image-capturing part that is installed in the vehicle and captures an image including a part of a vehicle cabin of the vehicle and a part of the periphery of the vehicle, wherein the transmitter transmits the image captured by the second-image-capturing part to the mobile terminal based on a transmit request from the mobile terminal.

5. The in-vehicle apparatus of claim 1, wherein the image generator starts generating the first bird'"'"'s-eye image when a target in the periphery of the vehicle is approaching the vehicle.

6. The in-vehicle apparatus of claim 1, wherein the mobile terminal is a terminal that is carried by a user of the vehicle and is located externally of the vehicle.

7. An image providing method for wirelessly communicating an image from a vehicle to a mobile terminal, the method comprising the steps of:

(a) capturing an image of a periphery of the vehicle from the vehicle;

(b) generating a first bird'"'"'s-eye image including the vehicle and the periphery of the vehicle viewed from a first virtual viewpoint based on the captured image of the periphery of the vehicle;

(c) wirelessly transmitting the generated first bird'"'"'s-eye image to the mobile terminal;

(d) detecting a target approaching the vehicle, wherein the method further comprises the steps of;

based on a change request from the mobile terminal, changing the first virtual viewpoint to a second virtual viewpoint and generating a second bird'"'"'s-eye image viewed from the second virtual viewpoint after changing from the first virtual viewpoint to the second virtual viewpoint, and

when a signal indicating that an automatic follow-up is selected is received from the mobile terminal, initiating an automatic follow-up that is free from user input, the automatic follow-up causes the image-capturing part to point at the target approaching the vehicle, and

(e) sending the first bird'"'"'s-eye image from the first virtual viewpoint and sending the second bird'"'"'s eye-image from the second virtual viewpoint based on the received change request, and then sending a video when the signal indicating that the automatic follow-up is selected is received from the mobile terminal.

8. The image providing method of claim 7, further comprising the step of detecting a target in the periphery of the vehicle, wherein the generation step includes starting generation of the first bird'"'"'s-eye image when the target has been detected in the periphery of the vehicle.

9. The image providing method of claim 7, wherein the wireless transmission step includes transmitting the captured image of the periphery of the vehicle based on a transmit request received from the mobile terminal.

10. The image providing method of claim 7, further comprising the step of capturing another image including a part of a vehicle cabin of the vehicle and apart of the periphery of the vehicle, wherein the wireless transmission step includes transmitting the captured another image including the part of the vehicle cabin to the mobile terminal based on a transmit request received from the mobile terminal.

11. The image providing method of claim 7, wherein the generation of the first bird'"'"'s-eye image includes generating the first bird'"'"'s-eye image when a target in the periphery of the vehicle is approaching the vehicle.

12. The image providing method of claim 7, wherein the mobile terminal is a terminal that is carried by a user of the vehicle and is located externally of the vehicle.

13. A non-transitory computer-readable recording medium configured to store a program executable by a computer included in an in-vehicle apparatus that is installed in a vehicle, the in-vehicle apparatus being configured to wirelessly communicate with a mobile terminal, the program including instructions, that when executed by the computer, perform steps of:

(a) capturing an image of a periphery of the vehicle from the vehicle;

(b) generating a first bird'"'"'s-eye image including the vehicle and the periphery of the vehicle viewed from a first virtual viewpoint based on the captured image of the periphery of the vehicle;

(c) wirelessly transmitting the generated first bird'"'"'s-eye image to the mobile terminal;

(d) detecting a target approaching the vehicle, wherein the program instructions further comprise;

based on a change request from the mobile terminal, changing the first virtual viewpoint to a second virtual viewpoint and generating a second bird'"'"'s-eye image viewed from the second virtual viewpoint after changing from the first virtual viewpoint to the second virtual viewpoint, and

when a signal indicating that an automatic follow-up is selected is received from the mobile terminal, initiating an automatic follow-up that is free from user input, the automatic follow-up causing the image-capturing part to point at the target approaching the vehicle, and

(e) sending the first bird'"'"'s-eye image from the first virtual viewpoint and sending the second bird'"'"'s eye-image from the second virtual viewpoint based on the received change request and then sending a video when the signal indicating that the automatic follow-up is selected is received from the mobile terminal.

14. The recording medium of claim 13, the program instructions further comprise the step of detecting a target in the periphery of the vehicle, wherein the generation step includes starting generation of the first bird'"'"'s-eye image when the target has been detected in the periphery of the vehicle.

15. The recording medium of claim 13, wherein the wireless transmission step includes transmitting the captured image of the periphery of the vehicle based on a transmit request received from the mobile terminal.

16. The recording medium of claim 13, the program instructions further comprises the step of capturing another image including a part of a vehicle cabin of the vehicle and a part of the periphery of the vehicle, wherein the wireless transmission step includes transmitting the captured another image including the part of the vehicle cabin to the mobile terminal based on a transmit request received from the terminal.

17. The recording medium of claim 13, wherein the generation of the first bird'"'"'s-eye image includes generating the first bird'"'"'s-eye image when a target in the periphery of the vehicle is approaching the vehicle.

18. The recording medium of claim 13, wherein the mobile terminal is a terminal that is carried by a user of the vehicle and is located externally of the vehicle.