SYSTEM AND METHOD FOR ENHANCED TIME-LAPSE VIDEO GENERATION USING PANORAMIC IMAGERY

• US 20150221341A1
• Filed: 01/31/2014
• Published: 08/06/2015
• Est. Priority Date: 01/31/2014
• Status: Abandoned Application

• Current Assignee: Audi AG (Volkswagen AG), Volkswagen AG
• Original Assignee: Audi AG (Volkswagen AG), Volkswagen AG
• Inventors: AKAY, Sinan
• Application Number:
  US14/169,546
• Publication Number:
  US 20150221341A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/3679 Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities G01C21/3611 takes precedence
• CPC Class Codes: G01S 19/03 Cooperating elements; Interaction or communication between different cooperating elements or between cooperating elements and receivers
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/9305 involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

A system for periodically recording GPS coordinates of a vehicle during the vehicle driver'"'"'s trip as trip coordinates, at times when the driver gazes away from the direction of travel, recording a potential point in interest in accordance with the current GPS coordinates and an angle of the driver'"'"'s eye gaze, and after reaching the destination, sending the trip coordinates and the point of interest coordinates to a remote server. The remote server may then retrieve from a GPS coordinate-tagged image database, panoramic images corresponding to the trip coordinates and potential POI coordinates. The driver, or any other user of the system, can then create an enhanced time-lapse video of the driver'"'"'s trip by converting the retrieved panoramic images into a video focusing on points of interest capturing the attention of the driver.

Claims

1. A system for creating a video of a vehicle'"'"'s trip from an origin to a destination, comprising:

a vehicle in operative communication with a server, having;

a first processor in data communication with;

a global positioning system (GPS) module;

a first cellular data transceiver;

means for detecting when a driver gazes away from the road ahead and toward a potential point of interest; and

a non-transitory storage device on which is stored computer readable code which, when executed by the first processor, causes the vehicle to;

periodically record the vehicle'"'"'s GPS coordinates during the trip as trip coordinates;

when the driver'"'"'s eye gaze is detected, record a potential point of interest in accordance with the vehicle'"'"'s GPS coordinates and an angle of the driver'"'"'s eye gaze;

after the vehicle reaches the destination, send the periodically recorded trip coordinates and the potential point of interest to the server via the cellular data transceiver; and

the server having;

a second processor in data communication with;

a second cellular data transceiver; and

a point of interest database containing GPS coordinates of predetermined points of interest; and

means for comparing the recorded potential point of interest to the GPS coordinates of the predetermined points of interest to determine confirmed point of interest coordinates;

means for retrieving from a GPS coordinate-tagged image database, images corresponding to the confirmed point of interest coordinates and the trip coordinates; and

means for converting the retrieved images into a time-lapse video of the vehicle'"'"'s trip.

2. The system of claim 1, wherein the computer readable code causes the vehicle to record, at the same time the driver gazes away from the road, at least one of a current speed of the vehicle, a current revolutions per minute rate of a motor of the vehicle, and a current time of day.

3. The system of claim 2, wherein the retrieved images correspond to the time of day the driver gazed away from the road.

4. The system of claim 1, wherein the computer readable code causes the vehicle to record a correlation between a current vehicle location and the angle of the driver'"'"'s eye gaze.

5. A vehicle in operative communication with a server and configured to operate as part of a system for creating a video of the vehicle'"'"'s trip from an origin to a destination, the vehicle comprising:

a processor in data communication with;

a global positioning system (GPS) module;

a cellular data transceiver;

a driver monitoring unit configured to detect a driver trigger as a potential point of interest; and

a non-transitory storage device on which is stored computer readable code which, when executed by the processor, causes the vehicle to;

periodically record the vehicle'"'"'s geographic coordinates during the trip as trip coordinates;

record a potential point of interest in accordance with the vehicle'"'"'s GPS coordinates and an angle of the driver'"'"'s eye gaze; and

after the vehicle reaches the destination, send the periodically recorded trip coordinates and the potential point of interest coordinates to the server via the cellular data transceiver.

6. The vehicle of claim 5, wherein the driver trigger comprises a driver'"'"'s gaze away from a road in front of the driver.

7. The vehicle of claim 5, wherein the driver trigger comprises the driver depressing a key substantially contemporaneously with the driver'"'"'s gaze away from the road.

8. The vehicle of claim 5, wherein the driver monitoring unit is further configured to detect a direction of a gesture of the driver.

9. The vehicle of claim 5, further comprising a navigation display, wherein the driver trigger comprises the driver highlighting the potential point of interest on the navigation display.

10. The vehicle of claim 5, wherein the video can include at least one of an image taken from the interior of the vehicle and an image of the confirmed points of interest taken from the exterior of the vehicle.

11. A server configured to operate as part of a system for creating a video of the vehicle'"'"'s trip from an origin to a destination, comprising:

a processor in data communication with;

a cellular data transceiver configured to receive;

trip coordinates corresponding to periodically recorded geospatial positioning system (GPS) coordinates of the vehicle during the trip;

a potential point of interest based on vehicle GPS coordinates and an angle of the driver'"'"'s eye gaze when a trigger event of a driver of the vehicle is detected; and

record a site in accordance with the vehicle'"'"'s GPS coordinates and an angle of the

driver'"'"'s eye gaze as a potential point of interest a non-transitory storage device on which is stored;

a point of interest database containing geospatial positioning system (GPS) locations of predetermined points of interest; and

computer readable code which, when executed by the processor, causes the server to;

compare the received potential points of interest GPS and the predetermined points of interest to determine confirmed point of interest coordinates;

retrieve from a GPS coordinate-tagged image database, images corresponding to the confirmed point of interest coordinates and the received trip coordinates; and

convert the images into the video of the trip.

12. The server of claim 11, wherein the retrieved images correspond to a time of day the driver gazed away from a road in front of the driver.

13. The server of claim 11, wherein the video includes vehicle operating condition information comprising at least one of:

a current speed of the vehicle and a current revolutions per minute (RPM) rate of a motor of the vehicle.

14. The server of claim 11, wherein the computer code causes the server to additionally retrieve images in accordance with the angle of the driver'"'"'s gaze.

15. The server of claim 11, wherein the images comprise street-view panoramic images.

16. A method for creating a video of a vehicle'"'"'s trip from an origin to a destination, the method comprising:

periodically recording geospatial positioning system (GPS) coordinates of the vehicle during the trip as trip coordinates;

detecting a driver trigger event as a potential point of interest;

recording GPS coordinates and a driver'"'"'s gaze angle when the driver trigger is detected as potential point of interest coordinates; and

after reaching the destination, sending the trip coordinates and the potential point of interest coordinates to a remote server.

17. The method of claim 16, wherein the driver trigger comprises a driver'"'"'s gaze away from the road in front of the driver.

18. The method of claim 16, wherein the driver trigger comprises the driver depressing a key substantially contemporaneously with the driver'"'"'s gaze away from the road.

19. The method of claim 16, wherein the detecting a driver trigger comprises detecting a direction of a gesture of the driver.

20. The method of claim 16, further comprising a navigation display, wherein the driver trigger comprises the driver highlighting the potential point of interest on the navigation display.

21. A method for creating a video of a vehicle'"'"'s trip from an origin to a destination, the method comprising:

retrieving trip coordinates from the vehicle, wherein the trip coordinates correspond to periodically recorded geospatial positioning system (GPS) coordinates of the vehicle during the trip;

retrieving potential point of interest corresponding to vehicle GPS coordinates recorded when a trigger event of a driver of the vehicle is detected and an angle of the driver'"'"'s eye gaze;

comparing the potential point of interest with locations of predetermined points of interest to determine confirmed point of interest coordinates;

retrieving, from a GPS coordinate-tagged image database, images corresponding to both the confirmed point of interest coordinates and the trip coordinates; and

converting the images into a time-lapse video of the trip.

22. The method of claim 21, wherein the retrieved images correspond to the time of day the driver gazed away from the road in front of the driver.

23. The method of claim 21, wherein the video includes vehicle operating condition information comprising at least one of a current speed of the vehicle and a current revolutions per minute (RPM) rate of a motor of the vehicle.

24. The method of claim 21, wherein the retrieving further comprises retrieving images in accordance with the angle of the driver'"'"'s eye gaze.

25. The method of claim 21, wherein the images comprise street-view panoramic images.