Smart vehicle video management

• US 7,463,281 B2
• Filed: 12/12/2003
• Issued: 12/09/2008
• Est. Priority Date: 08/06/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Luskin, Eugene, Kizhnerman, David, Petrochuk, Andrew
• Primary Examiner(s): DIEP, NHON THANH
• Application Number:
  US10/735,393
• Publication Number:
  US 20050030379A1
• Time in Patent Office: 1,824 Days
• Field of Search: None
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 1/30 providing vision in the non-visible spectrum, e.g. night or infrared vision
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/106 using night vision cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/8013 for child monitoring
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8053 for bad weather conditions or night vision
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A method includes selecting a video source view from at least one of a plurality of vehicle-mounted video sources based on detection of a vehicle event. The video source view may be displayed according to a presentation mode. The method may include associating a plurality of vehicle events with a video source view or video presentation mode. A system includes display logic selecting a video source view from a plurality of vehicle-mounted video sources based on detection of a vehicle event. The system can include presentation rules specifying an association between a plurality of vehicle events and a video source view and/or a video presentation mode. The presentation rules are editable and configurable.

Claims

1. A method for implementing a user configurable video management system on a vehicle, the method comprising:

selecting multiple sets of multiple video source views from a plurality of vehicle-mounted video sources, the multiple sets based on;

a default mode; and

detection of a plurality of vehicle events; and

displaying the multiple video source views of one of the multiple sets simultaneously,

wherein the displaying comprises a full view mode of one of the multiple video source views of the one of the multiple sets, and multiple windows within the full view mode, each of the multiple windows containing another of the multiple video source views of the one of the multiple sets; and

configuring each of the multiple sets of the multiple video source views according to user-definable presentation modes, the presentation modes comprising the default mode and other modes, the other modes being based on the plurality of vehicle events.

2. A method as recited in claim 1, wherein the user-definable presentation modes are pre-assigned by a user configuring presentation rules associated with each of the presentation modes, wherein the configuring of the presentation rules by the user is facilitated by a user input device at the video management system.

3. A method as recited in claim 1 further comprising detecting one of the plurality of vehicle events that is associated with one of the multiple set of multiple video source views.

4. A method as recited in claim 1 further comprising associating a plurality of vehicle events with at least one video source view.

5. A method as recited in claim 1 further comprising associating, by a user, the plurality of vehicle events with at least one video presentation mode.

6. A method as recited in claim 1 further comprising configuring, by a user, a data structure on a computer readable medium, the data structure comprising an association between a vehicle event indicator and video source view.

7. A method as recited in claim 1 further comprising configuring a data structure on a computer readable medium, the data structure comprising an association between a vehicle event indicator and a mode of presenting a video source view.

8. A method as recited in claim 1 wherein each of the plurality of vehicle events comprises at least one of:

a left turn signal state;

a right turn signal state;

a left front door open signal state;

a left rear door open signal state;

a right front door open signal state;

a right rear door open signal state;

a headlights signal state;

a reverse gear signal state;

an obstacle detection signal state;

a light sensor state;

a temperature sensor state;

an audio sensor state.

9. A method as recited in claim 1 wherein the selecting comprises looking up an event indicator corresponding to the event in a table of video presentation rules.

10. A method as recited in claim 1 further comprising configuring, by a user, presentation rules associating a plurality of event indicators with a plurality of video display modes.

11. A method as recited in claim 1, wherein the user-definable presentation modes are pre-assigned by a user configuring presentation rules associated with the presentation modes, wherein the configuring of the presentation rules by the user is facilitated by a remote computing device to edit the presentation rules and upload the edited presentation rules into the vehicle video management system.

12. A computer-readable medium encoded with a computer program, that when executed by a processor in a vehicle video management system, perform a process, the process comprising:

selecting multiple sets of multiple video source views from a plurality of vehicle-mounted video sources, the multiple sets being based on;

a default mode; and

detection of a plurality of vehicle events; and

displaying the multiple video source views of one of the multiple sets simultaneously, wherein the displaying comprises a full view mode of one of the multiple video source views of the one of the multiple sets, and multiple windows within the full view mode containing another of the multiple video source views of the one of the multiple sets; and

configuring each of the multiple sets of the multiple video source views according to user-definable presentation modes, the presentation modes comprising the default mode and other modes, each of the other modes being associated with each of the plurality of vehicle events.

13. A computer-readable medium as recited in claim 12, wherein the user-definable presentation modes are pre-assigned by a user editing presentation rules associated with each of the presentation modes.

14. A computer-readable medium as recited in claim 13, wherein the displaying operation further comprises simultaneously displaying more than two video source views.

15. A method as recited in claim 13, wherein the user-definable presentation modes are pre-assigned by a user editing presentation rules associated with the presentation modes, wherein the editing of the presentation rules by the user is facilitated by a user input device at the vehicle video management system.

16. A method as recited in claim 13, wherein the user-definable presentation modes are pre-assigned by a user editing presentation rules associated with the presentation modes, wherein the editing of the presentation rules by the user is facilitated by a remote computing device to edit the presentation rules and upload the edited presentation rules into the vehicle video management system.

17. A computer-readable medium as recited in claim 12, the process further comprising detecting one of the plurality of vehicle events that is associated with one of the multiple set of multiple video source views.

18. A computer-readable medium as recited in claim 12,the process further comprising associating, by a user, the plurality of vehicle events with at least one video source view.

19. A computer-readable medium as recited in claim 12, the process further comprising associating the plurality of vehicle events with at least one video presentation mode.

20. A computer-readable medium as recited in claim 12, the process further comprising configuring a data structure on a computer readable medium, the data structure comprising an association between a vehicle event indicator and video source view.

21. A computer-readable medium as recited in claim 12 the process further comprising configuring a data structure, by a user, on a computer readable medium, the data structure comprising an association between a vehicle event indicator and a mode of presenting a video source view.

22. A computer-readable medium as recited in claim 12, wherein each of the vehicle events comprises at least one of:

a left turn signal state;

a right turn signal state;

a left front door open signal state;

a left rear door open signal state;

a right front door open signal state;

a right rear door open signal state;

a lights on signal state;

a reverse gear signal state;

an obstacle detection signal state;

a light sensor state;

a temperature sensor state;

an audio sensor state.

23. A computer-readable medium as recited in claim 12 wherein the selecting comprises looking up an event indicator corresponding to the event in a table of video presentation rules.

24. A computer-readable medium as recited in claim 12, the process further comprising configuring presentation rules associating a plurality of event indicators with a plurality of video display modes.

25. A vehicle video management system, the system comprising:

display logic selecting multiple video source views from a plurality of vehicle-mounted video sources based on detection of a vehicle event;

a display device for displaying the multiple video source views simultaneously, wherein the displaying comprises a full view mode of one of the multiple video source views, and a multiple windows within the full view mode containing another of the multiple video source views, wherein the display device displaying the multiple video source views is performed according to a presentation mode; and

a user interface to receive input by a user of the system for pre-configuring multiple presentation modes, the multiple presentation modes comprising;

a default mode; and

other modes each based on each of a plurality of detected vehicle events.

26. A system as recited in claim 25 further comprising a vehicle sensor detecting the vehicle event.

27. A system as recited in claim 25 further comprising presentation rules including an association between a plurality of vehicle events and at least one video source view.

28. A system as recited in claim 25 further comprising presentation rules including an association between a plurality of vehicle events and at least one video presentation mode.

29. A system as recited in claim 25, wherein the user interface is operable to receive input by the user of the system for configuring a data structure on a computer readable medium, the data structure comprising an association between a vehicle event indicator and video source view.

30. A system as recited in claim 25, wherein the user interface is operable to receive input by the user of the system for configuring a data structure on a computer readable medium, the data structure comprising an association between a vehicle event indicator and a mode of presenting a video source view.

31. A system as recited in claim 25, wherein the display device displays one of the multiple video source views in the default mode, wherein the default mode has been configured by the user of the system at a remote computer and uploaded to the system, wherein the display device displays the default mode when no vehicle events are detected.

32. A system as recited in claim 25, wherein the display device simultaneously displays two or more video source views.

33. A system as recited in claim 25 wherein the vehicle event comprises at least one of:

a left turn signal state;

a right turn signal state;

a left front door open signal state;

a left rear door open signal state;

a right rear door open signal state;

a lights on signal state;

a reverse gear signal state;

an obstacle detection signal state;

a light sensor state;

a temperature sensor state;

an audio sensor state.

34. A system as recited in claim 25 wherein the display logic looks up an event indicator corresponding to the event in a table of video presentation rules.

35. A system as recited in claim 25 further comprising extensible presentation rules associating a plurality of event indicators with a plurality of video display modes.

36. A vehicle comprising:

a computer having display logic selecting multiple video source views from a plurality of video sources mounted on the vehicle based on detection of a vehicle event;

a display device communicating with the computer for displaying the multiple video source views simultaneously, wherein the displaying comprises a full view mode of one of the multiple video source views, and multiple windows within the full view mode containing another of the multiple video source views, wherein the display device communicating with the computer to display the multiple video source views is performed according to a presentation mode; and

a user interface to receive input by a user of the vehicle for pre-configuring multiple presentation modes, the multiple presentation modes comprising;

a default mode for displaying when no vehicle event is detected; and

other modes each based on each of a plurality of detected vehicle events.

37. A vehicle as recited in claim 36 further comprising a vehicle sensor in communication with the computer, the vehicle sensor detecting the vehicle event.

38. A vehicle as recited in claim 36, wherein the computer further comprises a computer-readable medium having stored thereon presentation rules including an association between a plurality of vehicle events and at least one video source view.

39. A vehicle as recited in claim 36, wherein the computer further comprises a computer-readable medium having stored thereon presentation rules including an association between a plurality of vehicle events and at least one video presentation mode.

40. A vehicle as recited in claim 36, wherein the user interface is operable to receive input by the user of the vehicle for configuring a data structure on a computer-readable medium, the data structure comprising an association between a vehicle event indicator and video source view, the data structure being readable by the display logic to select the video source view.

41. A vehicle as recited in claim 36, wherein the user interface is operable to receive input by the user of the vehicle for configuring a data structure on a computer readable medium, the data structure comprising an association between a vehicle event indicator and a mode of presenting a video source view, the data structure being readable by the display logic to select the video source view.

42. A vehicle as recited in claim 36, wherein the display device displays one of the multiple video source views in the default mode, wherein the default mode has been configured by the user of the vehicle at a remote computer and uploaded to the vehicle.

43. A vehicle as recited in claim 36, wherein the display device simultaneously displays more than two video source views.

44. A vehicle as recited in claim 36 wherein the vehicle event is selected from a group comprising:

a left turn signal state;

a right turn signal state;

a left front door open signal state;

a left rear door open signal state;

a right front door open signal state;

a right rear door open signal state;

a lights on signal state;

a reverse gear signal state;

an obstacle detection signal state;

a light sensor state;

a temperature sensor state;

an audio sensor state.

45. A vehicle as recited in claim 36 wherein the display logic looks up an event indicator corresponding to the event in a table of video presentation rules.

46. A vehicle as recited in claim 36 further comprising extensible presentation rules associating a plurality of event indicators with a plurality of video display modes.