Displayed view modification in a vehicle-to-vehicle network

• US 8,345,098 B2
• Filed: 03/17/2008
• Issued: 01/01/2013
• Est. Priority Date: 03/17/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Grigsby, Travis M., Miller, Steven Michael, Nesbitt, Pamela Ann, Seacat, Lisa Anne
• Primary Examiner(s): Nguyen, Thu
• Assistant Examiner(s): WIDHALM DE RODRIG, ANGELA MARIE
• Application Number:
  US12/049,436
• Publication Number:
  US 20090231431A1
• Time in Patent Office: 1,751 Days
• Field of Search: None
• US Class Current: 348/148
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G08G 1/161 Decentralised systems, e.g. inter-vehicle communication

Abstract

In V2V or other networks in which multiple video cameras can share video data, a user may elect to modify a primary view by electronically “removing” obstructing objects from the primary view. The user begins by identifying the objects to be electronically removed from the simulated view, either by designating the boundaries of the objects or by identifying classes of objects to be removed. Pel locations associated with obstructing objects are identified in the primary data set. Video data provided by cameras other than a primary video camera is analyzed to identify common features in the primary and secondary views and to identify pels that correspond with object-associated pels in the primary view. A merged data set, consisting of pel data from the primary data set and from at least one of the secondary data sets, provides the video data presented in the simulated view.

Claims

1. A method of generating a view for presentation on a video display comprising:

receiving a primary set of video data from a first video camera, wherein the first video camera is located on a first participant, and the first participant is coupled to a communication network;

receiving user input designating an object to be excluded from the view presented on the video display;

receiving a secondary set of video data from a video camera other than the first video camera, wherein the video camera other than the first video camera is located on a second participant, and the second participant is coupled to the communication network;

associating data elements in said received secondary set of video data with data elements in said primary set of video data representing an object designated to be excluded from the view presented on the video display, wherein the associated data elements relate to an image of what is in front of the object designated to be excluded;

generating a set of video data comprising video data from said primary set and said associated data elements in said received secondary set; and

displaying the generated set of video data on the video display,

wherein the first participant and the second participant are configured to exchange data over the communication network.

2. A method according to claim 1 wherein each of the first participant and the second participant is a vehicle.

3. A method according to claim 2 further comprising modifying the generated set of video data to include a visible reminder that an object is excluded from the view that would have been presented by the primary set of video data.

4. A method according to claim 3 wherein the included visible reminder comprises a wire form representation of the excluded object.

5. A method according to claim 2 wherein receiving user input designating at least one object to be excluded from the view presented on the video display further comprises receiving the user input designating boundaries of the object to be excluded.

6. A method according to claim 5 wherein receiving the user input designating boundaries of the object to be excluded further comprises using an expandable bounding box to designate the boundaries.

7. A method according to claim 2 wherein receiving user input designating at least one object to be excluded further comprises receiving information designating a class of objects to be excluded from the view.

8. A system comprising a video display and a controller for generating of view to be presented on said video display, said controller comprising:

a first video input system for receiving a primary set of video data from a first video camera, wherein the first video camera is to be located on a first participant, and the first participant is to be coupled to a communication network;

a user interface system for receiving a user input designating at least one object to be excluded from the view presented on a video display;

a second video input system for receiving a secondary set of video data from a video camera other than the first video camera, wherein the video camera other than the first video camera is to be located on a second participant, and the second participant is to be coupled to the communication network;

video processing logic for associating data elements in said received secondary set of video data with data elements in said received primary set of video data representing an object designated to be excluded from the view presented on the video display, wherein the associated data elements are to relate to an image of what is in front of the object designated to be excluded;

video combining logic for generating a set of video data comprising video data from said primary set and said associated data elements in said received secondary set; and

video driver logic for displaying the generated set of video data on the video display, wherein the first participant and the second participant are to be configured to exchange data over the communication network.

9. A system according to claim 8 wherein each of the first participant and the second participant is a vehicle.

10. A system according to claim 9 wherein said video combining logic further comprises logic for modifying the generated set of video data to include a visible reminder that an object is excluded from the view that would have been presented by the primary set of video data.

11. A system according to claim 10 wherein the included visible reminder comprises a wire form representation of the excluded object.

12. A system according to claim 9 wherein said user interface system further comprises means for receiving user input designating boundaries of the object to be excluded.

13. A computer program product for generating a view for presentation on a video display, said computer program product comprising a computer storage device having computer usable program code embodied therewith, said computer usable program code comprising:

computer usable program code configured to receive a primary sct of video data from a first video camera, wherein the first video camera is to be located on a first participant, and the first participant is to be coupled to a communication network;

computer usable program code configured to receive user input designating at least one object to be excluded from the view presented on the video display;

computer usable program code configured to receive a secondary set of video data from a video camera other than the first video camera, wherein the video camera other than the first video camera is to be located on a second participant, and the second participant is to be coupled to the communication network;

computer usable program code configured to associate data elements in said received secondary set of video data with data elements in said received primary set of video data representing an object designated to be excluded from the view presented on the video display, wherein the associated data elements are to relate to an image of what is in front of the object designated to be excluded;

computer usable program code configured to generate a set of video data comprising video data from said primary set and said associated data elements in said received secondary sct; and

computer usable program code configured to display the generated set of video data on the video display,

wherein the first participant and the second participant are to be configured to exchange data over the communication network.

14. A computer program product according to claim 13 wherein each of the first participant and the second participant is a vehicle.

15. A computer program product according to claim 14 is further comprising computer usable program code configured to modify the generated set of video data to include a visible reminder that an object is excluded from the view that would have been presented by the primary set of video data.

16. A computer program product according to claim 15 wherein the included visible reminder comprises a wire form representation of the excluded object.

17. A computer program product according to claim 14 wherein said computer usable program code configured to receive user input designating at least one object to be excluded from the view presented on the video display further comprises computer usable program code configured to receive user input designating boundaries of the object to be excluded.

18. A computer program product according to claim 17 wherein said computer usable program code configured to receive user input designating boundaries of the object to be excluded further comprises computer usable program code configured to receive user input designating an expandable bounding box.

19. A computer program product according to claim 15 wherein said computer usable program code configured to receive user input designating at least one object to be excluded from the view presented on the video display further comprising computer usable program code configured to receive user input designating a class of objects to be excluded from the view.