Apparatus and method for recording "path-enhanced" multimedia

• US 20040218895A1
• Filed: 04/30/2003
• Published: 11/04/2004
• Est. Priority Date: 04/30/2003
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Samadani, Ramin, Harville, Michael
• Granted Patent: US 7,526,718 B2
• Time in Patent Office: Days
• US Class Current: 386/46
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04N 5/9201 involving the multiplexing of an additional signal and the video signal

Abstract

A “path-enhanced” recorder combines the recording of multimedia data files (typically, but not necessarily, using conventional digital audio, photo, and video recording technology), along with quasi-continuous capturing of time and position data to permit a subsequent reconstruction of the user'"'"'s entire path, preferably including times and/or locations at which no multimedia data files were being recorded. A “path-enhanced” recorder device thus provides a combined record of not only multimedia data files but also data concerning path traveled between (and possibly during) the capturing of individual recorded media files to thereby create “path-enhanced” multimedia, which in turn facilitates a number of contemplated applications including the Automatic Generation of Presentations; Exploration, Enhancement and Editing of “Path-Enhanced” Multimedia; and Searching of “Path-Enhanced” Multimedia Databases.

Claims

1. A recorder comprising:

a path information determining subsystem, for determining essentially on a continuous basis and recording path information associated with a path traversed by the recorder, the information having associated path time and location data;

a multimedia recording subsystem for recording selected multimedia data while traversing the path and associating at least a portion of the multimedia data with said path information to generate “

path-enhanced”

multimedia data.

2. The recorder of claim 1 further comprising a data transfer subsystem for transferring at least the “

path enhanced”

multimedia data external to the recorder.

3. The recorder of claim 1 further comprising control for disabling one of the path information determining subsystem and the multimedia recording subsystem to allow one of path information and multimedia data to be recorded while the other is not.

4. The recorder of claim 1 further comprising control for prohibiting associating at least a portion of the path information with the multimedia data.

5. The recorder of claim 1 wherein its operation is controlled dependent on one of time of day and external stimuli.

6. The recorder of claim 1 wherein its operation is controlled manually or by voice.

7. The recorder of claim 1 further comprising control for allowing a user to designate into categories at least portions of one of multimedia data and path information.

8. The recorder of claim 1 comprising at least one sensor for capturing at least one type of multimedia including at least audio, video, still images, and text.

9. The recorder of claim 1 wherein the multimedia recording subsystem records more than one type of multimedia from the group including at least audio, video, still images and text.

10. The recorder of claim 1 wherein at least one multimedia type including at least audio, video, and still image is associated with the same path time and location data.

11. The recorder of claim 1 wherein the path information and multimedia data are associated by timestamping each of the location data and the multimedia data.

12. The recorder of claim 1 wherein the path information and the multimedia data are associated using pointers.

13. The recorder of claim 3, wherein, whenever the recording of path information is disabled, multimedia data is associated with data that defines a sequential order in which the multimedia data is recorded.

14. The recorder of claim 1 wherein the path information determining subsystem determines the path information using path-determining information from at least one external source to the recorder.

15. The recorder of claim 1 further comprising at least one receiver for receiving at least one of GPS signals, additional location-determining signals, and time signals.

16. The recorder of claim 14 wherein path-determining information from each of the external sources is weighted dependent on accuracy.

17. The recorder of claim 14 wherein path information is determined by interpolation when path-determining information is unreliable.

18. The recorder of claim 14 further comprising a means for switching between the external sources.

19. The recorder of claim 1 further comprising an accelerometer for providing data to determine spatial displacement of the recorder so as to determine path location data.

20. The recorder of claim 1 wherein the path information determination subsystem further includes means for storing path-determining information.

21. The recorder of claim 1 further comprising a clock circuit including an internal clock, wherein in response to GPS signals the clock circuit generates the path time data.

22. The recorder of claim 1 further comprising path information storage for sampling and storing the determined path information including the path time and location data.

23. The recorder of claim 22 further comprising control for selecting a rate at which to sample the path information.

24. The recorder of claim 22 further comprising adaptive control for selecting a rate at which to sample the path information dependent on the movement of the recorder.

25. The recorder of claim 1 further comprising auxiliary sensors including at least one of a thermometer, barometer, altimeter, compass, inclinometer and accelerometer for providing auxiliary data for augmenting path information.

26. The recorder of claim 25 wherein the auxiliary data is used to estimate “

field-of-view”

of an image sensor including at least one of a video image sensor and a still image sensor.

27. The recorder of claim 1 further comprising a display screen and a means for rendering the “

path-enhanced’

multimedia data on the display screen.

28. The recorder of claim 1 implemented within a handheld device including at least one of a PDA and cellular phone.

29. The recorder of claim 1 implemented within a handheld device including at least one of a PDA and cellular phone.

30. The recorder of claim 1 further comprising control for restricting accessibility to at least a portion of at least one of the path information and the multimedia data by encryption.

31. The recorder of claim 1 further comprising control for restricting accessibility by allowing a user to designate into categories at least a portion of at least one of the path information and the multimedia data, wherein accessibility is dependent on the designated category.

32. The recorder of claim 31 wherein the control for restricting accessibility further comprises control for allowing a user to enter a password to obtain accessibility.