STORAGE MANAGING METHOD AND STORAGE MANAGEMENT DEVICE

• US 20130083197A1
• Filed: 11/21/2012
• Published: 04/04/2013
• Est. Priority Date: 05/25/2010
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: YAMAKAGE, Yuzuru, HAMAGUCHI, Shingo, OZAKI, Kazuyuki
• Granted Patent: US 9,787,946 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30248 Vehicle exterior or interior
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G07C 5/0891 Video recorder in combination with video camera
• CPC Class Codes: G09B 19/167 Control of land vehicles
• CPC Class Codes: G09B 9/042 providing simulation in a real vehicle G09B9/052, G09B9/058 take precedence
• CPC Class Codes: G09B 9/05 the view from a vehicle being simulated G09B9/052, G09B9/058 take precedence
• CPC Class Codes: G09B 9/052 characterised by provision for recording or measuring trainee's performance devices for psychotechnics, e.g. for vehicle drivers A61B5/16, A61B5/18
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

The disclosed video processing device contains: a video acquisition unit that acquires surroundings information including video taken of the surroundings of a vehicle; a line-of-sight acquisition unit that acquires the origin and direction of the line of sight of the driver of the aforementioned vehicle; a line-of-sight video generation unit which generates, from the surroundings information, line-of-sight video corresponding to the origin of the line of sight; a blocking-information computation unit that computes, on the basis of the origin of the line of sight, blocking information including video or a region of the body of the aforementioned vehicle that blocks the driver'"'"'s line of sight; and a display-video generation unit that generates display video on the basis of the line-of-sight video and the blocking information.

Claims

1. A picture processing device, comprising:

a picture acquisition unit configured to acquire peripheral information including a picture obtained by shooting a periphery of a driver'"'"'s vehicle;

a line-of-sight acquisition unit configured to acquire a line-of-sight origin and a direction of the line of sight of a driver of the driver'"'"'s vehicle;

a line-of-sight picture generation unit configured to generate from the peripheral information a line-of-sight picture corresponding to the line-of-sight origin;

a cutoff information calculation unit configured to calculate cutoff information including the car body area or a car body picture of the driver'"'"'s vehicle which cuts off a line of sight of the driver based on the line-of-sight origin; and

a display picture generation unit configured to generate a display picture according to the line-of-sight picture and the cutoff information.

2. The device according to claim 1, wherein:

the direction of the line of sight includes a car window line-of-sight direction from the line-of-sight origin through a window of the driver'"'"'s vehicle;

the line-of-sight picture includes a car window picture corresponding to the line-of-sight origin and the car window line-of-sight direction;

the cutoff information includes car window cutoff information containing a car body area and/or a car body picture of the driver'"'"'s vehicle about cutoff of the sight-of-line in the car window line-of-sight direction of the driver;

the display picture includes a car window display picture for observation by the driver through a window of the driver'"'"'s vehicle;

the line-of-sight picture generation unit comprises a window picture generation unit which generates the car window picture from a peripheral picture of the driver'"'"'s vehicle;

the cutoff information calculation unit calculates the car window cutoff information based on the line-of-sight origin; and

the display picture generation unit generates the car window display picture according to the car window picture and the car window cutoff information.

3. The device according to claim 1, wherein:

the line-of-sight picture includes a mirror picture corresponding to a visual mirror confirmation range in which the driver may perform a visual confirmation through at least one mirror of the driver'"'"'s vehicle;

the cutoff information includes mirror cutoff information containing a car body area and/or a car body picture of the driver'"'"'s vehicle which cuts off a mirror line-of-sight of the driver to the visual mirror confirmation range;

the display picture includes a mirror display picture for observation by the driver through at least one mirror of the driver'"'"'s vehicle;

the device further comprises a sight-of-line processing unit configured to calculate a effective vision range having a specified angle range in which the driver may perform a visual confirmation based on the line-of-sight origin and the direction of the line of sight, and determine whether or not there is at least one mirror of the driver'"'"'s vehicle in the effective vision range;

the line-of-sight picture generation unit comprises a mirror picture generation unit configured to calculate the visual mirror confirmation range in which the driver may perform a visual confirmation through the mirror according to mirror information including the line-of-sight origin and a position of the mirror when at least one mirror is located in the effective vision range, and generate the mirror picture corresponding to the visual mirror confirmation range from a peripheral picture of the driver'"'"'s vehicle;

the cutoff information calculation unit calculates the mirror cutoff information based on the line-of-sight origin and the visual mirror confirmation range; and

the display picture generation unit generates the mirror display picture according to the mirror picture and the mirror cutoff information.

4. The device according to claim 3, wherein

the display picture generation unit superposes the mirror display picture corresponding to a mirror in the effective vision range on the car window display picture when at least one mirror is located in the effective vision range.

5. The device according to claim 1, further comprising

a vision calculation unit configured to calculate a vision range of the driver according to at least one piece of biological information including a pupil, a number of pulses, perspiration, and a retention time in the direction of the line of sight;

and

the display picture generation unit processes the display picture based on the vision range.

6. The device according to claim 5, wherein

the display picture generation unit fades an area outside the vision range in the display picture.

7. The device according to claim 1, further comprising

a line-of-sight locus generation unit configured to generate a sight-of-line locus in the line-of-sight picture which is designated by the line-of-sight origin and the direction of the line of sight;

and

the display picture generation unit superposes the sight-of-line locus on the display picture.

8. The device according to claim 1, wherein

the line-of-sight origin is an average line-of-sight origin obtained by averaging line-of-sight origin of the driver in a specified time;

and

the direction of the line of sight is an average direction of the line of sight obtained by averaging a direction of the line of sight in the specified time.

9. The device according to claim 1, wherein

the line-of-sight picture generation unit generates a projection picture by projecting a peripheral picture of the driver'"'"'s vehicle on a 3-dimensional projection surface as a virtual space, and generates as the sight-of-line picture a picture corresponding to the line-of-sight origin and the direction of the line of sight in the projection picture.

10. The device according to claim 1, wherein

the display picture generation unit generates the display picture by removing a picture of an area of a body of the driver'"'"'s vehicle included in the cutoff information from the line-of-sight picture.

11. The device according to claim 1, wherein

the display picture generation unit generates the display picture by superposing a car body picture of the driver'"'"'s vehicle included in the cutoff information on the line-of-sight picture.

12. A non-temporary medium which stores a picture processing program used to direct a processor to perform a process, the process comprising:

acquiring peripheral information including a picture obtained by shooting a periphery of a driver'"'"'s vehicle;

acquiring a line-of-sight origin and a direction of the line of sight of a driver of the driver'"'"'s vehicle;

generating from the peripheral information a line-of-sight picture corresponding to the line-of-sight origin;

calculating cutoff information including the car body area or a car body picture of the driver'"'"'s vehicle which cuts off a line of sight of the driver based on the line-of-sight origin; and

generating a display picture according to the line-of-sight picture and the cutoff information.

13. A method for allowing a processor to perform a process, the method comprising:

acquiring peripheral information including a picture obtained by shooting a periphery of a driver'"'"'s vehicle;

acquiring a line-of-sight origin and a direction of the line of sight of a driver of the driver'"'"'s vehicle;

generating from the peripheral information a line-of-sight picture corresponding to the line-of-sight origin;

calculating cutoff information including the car body area or a car body picture of the driver'"'"'s vehicle which cuts off a line of sight of the driver based on the line-of-sight origin; and

generating a display picture according to the line-of-sight picture and the cutoff information.