Video image type determination system, video image processing system, video image processing method and video image processing program

• US 7,730,814 B2
• Filed: 01/07/2005
• Issued: 06/08/2010
• Est. Priority Date: 01/26/2004
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Takahashi, Yusuke
• Primary Examiner(s): Lu; Tom Y
• Application Number:
  US10/587,423
• Publication Number:
  US 20070160291A1
• Time in Patent Office: 1,978 Days
• Field of Search: 382/103, 382/104, 382/106, 382/107, 382/181
• US Class Current: 82/104
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: Y10T 82/18 Lathe for wheel or axle

Abstract

A video image processing system, which determines a type of a video image scene and processes the video image based on a processing method corresponding to the type of the video image scene, is provided. A landmark feature variable obtaining section calculates the landmark feature variable on the basis of the photographing direction, the photographing position, and the landmark information. A moving feature variable obtaining section calculates a moving feature variable on the basis of the photographing position, the moving speed and route information. A video image type determining section determines a type of the video image scene on the basis of the landmark feature variable and the moving feature variable. A video image processing section determines a processing method of the video image on the basis of the type of the video image scene and a usage purpose, and processes the video image on the basis of the determined processing method. A display section displays the processed video image.

Claims

1. A video image processing system comprising:

a video image input section which inputs a video image photographed by a mobile video image photographing device;

a moving feature variable obtaining section which obtains a moving feature variable indicating a feature of said video image photographing device in a state of moving;

a video image type determining section which determines a type of a video image scene included in said video image on the basis of said moving feature variable; and

a video image processing section which determines a processing method of said video image on the basis of said type of said video image scene determined by said video image type determining section, and processes said video image on the basis of said determined processing method,

wherein said moving feature variable obtaining section includes;

a speed input section which obtains a moving speed of said video image photographing device,

a first position input section which obtains a photographing position of said video image photographing device, and

a moving feature variable calculating section which calculates a moving feature variable corresponding to said video image scene on the basis of said photographing position and said moving speed.

2. The video image processing system according to claim 1, further comprising:

a display section which displays said video image which is processed by said video image processing section.

3. The video image processing system according to claim 1, further comprising:

a route information memory section which stores route information,

wherein said moving feature variable calculating section calculates said moving feature variable corresponding to said video image scene on the basis of said route information, and said photographing position and said moving speed of said video image photographing device.

4. The video image processing system according to claim 3, wherein the route information includes at least any one of a route position, type, a number of lanes, a position of an intersection, a position of a junction, and existence of a signal.

5. The video image processing system according to claim 1, wherein said moving feature variable includes at least any one of a deviation variable between a current position of said video image photographing device and a predetermined route, a running speed, and a running straight variable.

6. The video image processing system according to claim 1, further comprising:

a landmark feature variable obtaining section which obtains a landmark feature variable indicating a feature of a landmark existing within a viewing angle of said video image,

wherein said video image type determining section determines said type of said video image scene on the basis of said landmark feature variable and said moving feature variable.

7. The video image processing system according to claim 6, wherein said landmark feature variable obtaining section includes:

a direction input section which obtains said photographing direction of said video image photographing device,

a second position input section which obtains said photographing position of said video image photographing device,

a landmark information memory section which stores landmark information including property information of said landmark, and

a landmark feature variable calculating section which calculates said landmark feature variable corresponding to said video image scene on the basis of said landmark information, said photographing position, and said photographing direction.

8. The video image processing system according to claim 7, wherein said landmark information includes a position and a form of said landmark.

9. The video image processing system according to claim 6, wherein said landmark feature variable includes at least any one of a size of said landmark on a screen and a deviation variable from a screen center.

10. The video image processing system according to claim 6, wherein said video image type determining section determines said type of said video image scene by determining whether or not said moving feature variable and said landmark feature variable are larger than threshold values.

11. The video image processing system according to claim 10, wherein said threshold values with respect to said moving feature variable and said landmark feature variable are changed depending on a usage purpose.

12. The video image processing system according to claim 6, wherein said video image type determining section calculates an importance level of said video image scene on the basis of at least one of values among said moving feature variable and said landmark feature variable, and determines said type of said video image scene when said calculated importance level is larger than a threshold value.

13. The video image processing system according to claim 1, wherein said type of said video image scene includes at least one of a turning corner scene, a landmark scene, a traffic congestion scene, a signal waiting scene, and other scene.

14. The video image processing system according to claim 13, wherein said video image processing section processes said video image so as to perform a slow replay in said video image scene which is determined as said turning corner scene, processes said video image so as to display a ticker of said landmark information in said video image scene which is determined as said landmark scene, processes said video image so as to delete said video image scene which is determined as said traffic congestion scene, processes said video image so as to delete a video image scene which is determined as said signal waiting scene, and processes said video image so as to perform a high-speed replay in said video image scene which is determined as said other scene.

15. A server of a video image processing system which processes a video image photographed by a video image photographing device, said server comprising:

a landmark information memory section which memorizes landmark information including property information of a landmark;

a landmark feature variable calculating section which calculates a landmark feature variable corresponding to a video image scene on the basis of said landmark information, and a photographing position and a photographing direction of said video image photographing device received from a terminal;

a route information memory section which memorizes route information;

a moving feature variable calculating section which calculates a moving feature variable corresponding to said video image scene on the basis of said route information, and said photographing position and said moving speed of said video image photographing device received from said terminal;

a video image type determining section which determines a type of said video image scene on the basis of said landmark feature variable and said moving feature variable;

a video image processing section which determines a processing method of said video image on the basis of said type of said video image scene, and processes said video image on the basis of said determined processing method; and

a server-side transmission section which transmits said video image processed by said video image processing section to said terminal via a communication network.

16. A server of a video image processing system which processes a video image photographed by a video image photographing device, said server comprising:

a landmark information memory section which memorizes landmark information including property information of a landmark;

a landmark feature variable calculating section which calculates a landmark feature variable corresponding to a video image scene on the basis of said landmark information, and a photographing position and a photographing direction of said video image photographing device received from a terminal;

a route information memory section which memorizes route information,

a moving feature variable calculating section which calculates a moving feature variable corresponding to said video image scene on the basis of said route information, and said photographing position and said moving speed of said video image photographing device received from said terminal,

a video image type determining section which determines a type of said video image scene on the basis of said landmark feature variable and said moving feature variable, and

a server-side transmission section which transmits said type of said video image scene to said terminal via a communication network.

17. A terminal of a video image processing system which processes a video image photographed by a video image photographing device, said terminal comprising:

a video image input section which inputs said video image;

a direction input section which inputs a photographing direction of said video image photographing device;

a position input section which inputs a photographing position of said video image photographing device;

a speed input section which inputs a moving speed of said video image photographing device;

a terminal-side transmission section which transmits said photographing direction, said photographing position and said moving speed to a server that determines a type of a video image scene via a communication network;

a video image processing section which determines a method to process said video image on the basis of said type of said video image scene received from said server, and processes said video image on the basis of said determined processing method; and

a video image display section which displays said video image processed by said video image processing section.

18. A video image processing method comprising:

inputting a video image photographed by a mobile video image photographing device;

obtaining a moving feature variable indicating a feature of said video image photographing device in a state of moving;

obtaining a landmark feature variable indicating a feature of a landmark existing within a viewing angle of said video image;

determining a type of a video image scene included in said video image on the basis of said moving feature variable and said landmark feature variable; and

determining a processing method of said video image on the basis of said type of said video image scene, and processing said video image on the basis of said determined processing method.

19. A video image processing program stored on a computer readable medium comprising code that, when executed, causes a computer to perform:

inputting a video image photographed by a mobile video image photographing device;

obtaining a moving feature variable indicating a feature of said video image photographing device in a state of moving;

obtaining a landmark feature variable indicating a feature of a landmark existing within a viewing angle of said video image;

determining a type of a video image scene included in said video image on the basis of said moving feature variable and said landmark feature variable; and

determining a method to process said video image on the basis of said type of said video image scene, and processing said video image on the basis of said determined processing method.