Controlling playback of a temporal stream with a user interface device

• US 20040027365A1
• Filed: 08/07/2002
• Published: 02/12/2004
• Est. Priority Date: 08/07/2002
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Burg, Bernard J., Sayers, Craig P.
• Application Number:
  US10/213,971
• Publication Number:
  US 20040027365A1
• Time in Patent Office: Days
• US Class Current: 345/700
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/329 on a disc [VTOC]
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42661 for reading from or writing on a magnetic storage medium, e.g. hard disk drive
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A method for controlling playback of a temporal stream with a user interface device. The temporal stream is captured at an event site. A point of interest at the event site is selected with the user interface device. A time that an action occurred at the selected point of interest is identified. An image from the temporal stream is identified based on the identified time. The identified image is displayed on the user interface device.

Claims

1. A method for controlling playback of a temporal stream with a user interface device, the temporal stream captured at an event site, the method comprising:

selecting a point of interest at the event site with the user interface device;

identifying a time that an action occurred at the selected point of interest;

identifying an image from the temporal stream based on the identified time; and

displaying the identified image on the user interface device.

2. The method of claim 1, and further comprising:

capturing a first image with the user interface device; and

processing the first image to identify the selected point of interest.

3. The method of claim 1, and further comprising:

sensing an orientation of the user interface device; and

identifying the selected point of interest based on the sensed orientation of the user interface device.

4. The method of claim 3, and further comprising:

sensing a position of the user interface device; and

wherein the selected point of interest is identified based on the sensed orientation and sensed position of the user interface device.

5. The method of claim 1, wherein the time that an action occurred at the selected point of interest is identified based on motion sensor information.

6. A system for controlling playback of a temporal stream captured at an event site, the method comprising:

a user interface device for selecting a point of interest at the event site;

a controller for identifying a time that motion occurred at the selected point of interest, the controller configured to identify an image from the temporal stream based on the identified time; and

the user interface device including a display for displaying the identified image.

7. The system of claim 6, and further comprising:

an image sensor in the user interface device for capturing a first image; and

wherein the controller is configured to process the first image to identify the selected point of interest.

8. The system of claim 6, and further comprising:

an orientation sensor for sensing an orientation of the user interface device when the point of interest is selected; and

wherein the controller is configured to identify the selected point of interest based on the sensed orientation of the user interface device.

9. The system of claim 8, and further comprising:

a position sensor for sensing a position of the user interface device when the point of interest is selected; and

wherein the controller is configured to identify the selected point of interest based on the sensed orientation and sensed position of the user interface device.

10. The system of claim 6, wherein the controller identifies a time that motion occurred at the selected point of interest based on information provided by at least one motion sensor.

11. A system for playing back images in a temporal stream captured at an event site, the method comprising:

means for selecting a spatial location at the event site;

means for identifying a time that motion occurred at the selected spatial location;

means for identifying an image from the temporal stream based on the identified time; and

means for displaying the identified image.

12. The system of claim 11, wherein the means for selecting a spatial location includes image sensing means for capturing a first image, the system further comprising:

means for processing the first image to identify the selected spatial location.

13. The system of claim 11, and further comprising:

orientation sensing means for sensing an orientation of the means for selecting a spatial location when the spatial location is selected; and

means for identifying the selected spatial location based on the sensed orientation.

14. The system of claim 13, and further comprising:

position sensing means for sensing a position of the means for selecting a spatial location when the spatial location is selected; and

means for identifying the selected spatial location based on the sensed orientation and sensed position.

15. The system of claim 11, wherein the means for identifying a time is configured to identify a time that motion occurred at the selected spatial location based on information provided by a means for sensing motion at the selected spatial location.

16. A method for capturing and playing back a temporal stream comprising:

capturing a temporal stream of images at an event site;

associating a time of capture with each image in the captured temporal stream;

storing location information identifying a plurality of spatial locations at the event site;

associating at least one time with each spatial location;

identifying one of the spatial locations at the event site with a user interface device;

identifying at least one image in the captured temporal stream based on the identified spatial location, the at least one time associated with the identified spatial location, and the times of capture associated with the images in the temporal stream; and

displaying an image on the user interface device based on the identified at least one image.

17. The method of claim 16, wherein the at least one time associated with each spatial location represents a time that an action occurred at that spatial location.

18. The method of claim 16, and further comprising:

associating camera orientation information with each image in-the captured temporal stream; and

wherein the identification of the at least one image is also based on the camera orientation information.

19. The method of claim 16, and further comprising:

associating camera orientation information with each image in the captured temporal stream; and

wherein the image displayed on the user interface device is synthesized based on the identified at least one image and the camera orientation information associated with the identified at least one image.

20. A method for playing back a temporal stream of images captured at an event site, each captured image including a plurality of regions and an associated time of capture, the method comprising:

providing mapping data that associates one of a plurality of spatial locations at the event site with each region of each captured image;

associating at least one time with each one of the plurality of spatial locations;

transmitting the temporal stream of images and the mapping data to a user interface device;

displaying the temporal stream of images on the user interface device;

selecting one of the plurality of spatial locations with the user interface device;

identifying at least one image in the captured temporal stream based on the selected spatial location, the at least one time associated with the selected spatial location, and the time of capture associated with the images in the temporal stream; and

displaying an image on the user interface device based on the identified at least one image.

21. The method of claim 20, wherein the step of selecting one of the spatial locations comprises:

selecting one of the plurality of regions of one of the images displayed on the user interface device; and

identifying the spatial location associated with the selected region.

22. The method of claim 20, wherein the step of selecting one of the spatial locations comprises:

displaying a virtual reality representation of the event site on the user interface device; and

sensing an orientation of the user interface device; and

identifying a spatial location based on the sensed orientation of the user interface device.

23. A method for playing back a temporal stream of images captured at an event site, each captured image including a plurality of regions and an associated time of capture, the method comprising:

associating at least one time with each one of a plurality of spatial locations at the event site;

providing mapping data that associates a time with each region of each captured image based on the times associated with the plurality of spatial locations;

transmitting the temporal stream of images and the mapping data to a user interface device;

displaying the temporal stream of images on the user interface device;

selecting one of the regions in one of the displayed images with the user interface device;

transmitting a time identifier from the user interface device, the time identifier identifying the time associated with the selected region;

identifying at least one image in the captured temporal stream based on the time identifier and the time of capture associated with the images in the temporal stream; and

displaying an image on the user interface device based on the identified at least one image.

24. A device for capturing and playing back a temporal stream comprising:

an image sensor for capturing a temporal stream of image frames at an event site and capturing an image of a point of interest at the event site, the image sensor configured to capture more image information in the image frames than viewed through the device by a user during capture of the temporal stream;

a controller for identifying image frames in the temporal stream that include the point of interest based on the captured image of the point of interest, the controller configured to process the identified image frames to identify at least one image frame that shows motion near the point of interest; and

a display for displaying an image based on the identified at least one image frame, the displayed image including the point of interest and additional image information that was not visible through the device by the user during capture of the temporal stream.

25. The device of claim 24, and further comprising:

an orientation sensor for sensing orientations of the device during capture of the temporal stream and during capture of the image of the point of interest; and

wherein the controller is configured to compare the orientation of the device during capture of the image of the point of interest with the orientations of the device during capture of the temporal stream to facilitate identifying images frames that include the point of interest.

26. A computer-readable medium having computer-executable instructions for performing a method of controlling playback of a temporal stream captured at an event site, the method comprising:

selecting a point of interest at the event site;

identifying a time that motion occurred at the selected point of interest;

identifying an image from the temporal stream based on the identified time; and

displaying the identified image.