Techniques for using an image for the retrieval of television program information

• US 7,616,840 B2
• Filed: 01/08/2009
• Issued: 11/10/2009
• Est. Priority Date: 04/11/2003
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Hull, Jonathan J., Erol, Berna, Lee, Dar-Shyang
• Primary Examiner(s): Johns; Andrew W
• Application Number:
  US12/350,900
• Publication Number:
  US 20090180697A1
• Time in Patent Office: 306 Days
• Field of Search: 382/100, 382/218, 382/305, 382/206, 348/161, 707/3, 707/6, 707/E17.019, 707/E17.02, 707/E17.022, 707/E17.023, 707/E17.028
• US Class Current: 382/305
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A method for determining a video file such as a television program file is provided. The method comprises receiving information identifying an input image; comparing the input image with a plurality of video files to determine a video file that includes information that is considered to match the input image; and providing access to that video file or otherwise performing an action in response to the determination.

Claims

1. A method for determining a video program from an image, the method comprising:

receiving identification information identifying an input image;

comparing the input image with image information for a plurality of video files using an image matching procedure;

determining a video file that includes image information matching the input image; and

providing access to the determined video file in response to receiving the identification information for the input image.

2. The method of claim 1, wherein the image information that is considered to match the input image comprises a keyframe of the determined video file.

3. The method of claim 1, wherein the plurality of video files include a plurality of recorded television programs, and wherein the input image corresponds to captured image from one of the recorded television programs.

4. The method of claim 3, wherein the captured image is captured using one of a (1) digital camera capturing a displayed image during playback of a recorded television program and (2) a video recorder operable to store an image of a television program at a selected point during the television program.

5. The method of claim 1, wherein comparing the input image with the plurality of video files comprises:

determining text in the input image,

determining text in the plurality of video files; and

comparing the text in the input image to text in the video files to determine the video file that includes information that matches the input image.

6. The method of claim 5, wherein the text in the input image corresponds to closed captioning information displayed at that point in the corresponding video file.

7. The method of claim 1, wherein determining the video file comprises:

determining temporal information associated with the input image; and

using the temporal information to determine the video file.

8. The method of claim 1, further comprising determining a portion of the determined video file that includes information that matches the input image.

9. The method of claim 8, wherein determining the portion of the determined video file comprises:

determining temporal information associated with the input image; and

using the temporal information to determine the portion.

10. The method of claim 1, further comprising performing an action with respect to the determined video file.

11. The method of claim 10, wherein the action comprises at least one of outputting, displaying, playing, storing, and sending the determined video file or an identified portion of the determined video file.

12. The method of claim 1, further comprising using a disambiguation process to determine the determined video file.

13. The method of claim 1, wherein determining the video file comprises:

determining association information that associates the input image with the determined video file.

14. The method of claim 1, wherein determining the video file may result in multiple determined video files.

15. The method of claim 1, wherein the input image is an image of an object, and determining the video file comprises identifying any video file including a matching image of that object, wherein the input image was not generated using the video file.

16. A method for locating a television program file, the method comprising:

determining a captured image, the captured image including an image of a television display;

determining contents of the image of the display; and

using the contents of the image of the display to search a plurality of television program files to identify one or more television program files that include the contents.

17. The method of claim 16, further comprising determining a portion in each of the one or more television program files that includes information that matches the contents of the display.

18. The method of claim 16, further comprising:

determining temporal information associated with the captured image; and

using the temporal information to determine a matching portion in each of the one or more television program files.

19. The method of claim 16, further comprising performing an action with respect to the identified television program file.

20. The method of claim 19, wherein the action comprises at least one of outputting, displaying, playing, storing, and sending the identified television program file or an identified portion of the identified television program file.

21. A data processing system for determining a video file, the data processing system comprising:

a processor;

a memory coupled to the processor, the memory configured to store a plurality of code modules for execution by the processor, the plurality of code modules comprising;

a code module for receiving identification information identifying an input image;

a code module for comparing the input image with image information for a plurality of video files using an image matching procedure;

a code module for determining a video file that includes image information matching the input image; and

a code module for providing access to the determined video file in response to receiving the identification information for the input image.

22. The data processing system of claim 21, wherein the image information that is considered to match the input image comprises a keyframe of the determined video file.

23. The data processing system of claim 21, wherein the plurality of video files include a plurality of recorded television programs, and wherein the input image corresponds to a captured image from one of the recorded television programs.

24. The data processing system of claim 23, wherein the captured image is captured using one of a (1) digital camera capturing a displayed image during playback of a recorded television program and (2) a video recorder operable to store an image of a television program at a selected point during the television program.

25. The data processing system of claim 21, wherein the code module for comparing the input image with the plurality of video files comprises:

a code module for determining text in the input image,

a code module for determining text in the plurality of video files; and

a code module for comparing the text in the input image to text in the video files to determine the video file that includes information that matches the input image.

26. The data processing system of claim 25, wherein the text in the input image corresponds to closed captioning information displayed at that point in the corresponding video file.

27. The data processing system of claim 21, wherein the code module for determining the video file comprises:

a code module for determining temporal information associated with the input image; and

a code module for using the temporal information to determine the video file.

28. The data processing system of claim 21, further comprising a code module for determining a portion of the determined video file that includes information that matches the input image.

29. The data processing system of claim 21, further comprising a code module for performing an action with respect to the determined video file, the action comprising at least one of outputting, displaying, playing, storing, and sending the determined video file or an identified portion of the determined video file.

30. A computer program product stored on a computer-readable medium for determining a video file, the computer program product comprising:

executable code for receiving identification information identifying an input image;

executable code for comparing the input image with image information for a plurality of video files using an image matching procedure;

executable code for determining a video file that includes image information matching the input image; and

executable code for providing access to the determined video file in response to receiving the identification information for the input image.

31. The computer program product of claim 30, wherein the image information that is considered to match the input image comprises a keyframe of the determined video file.

32. The computer program product of claim 30, wherein the plurality of video files include a plurality of recorded television programs, and wherein the input image corresponds to captured image from one of the recorded television programs.

33. The computer program product of claim 32, wherein the captured image is captured using one of a (1) digital camera capturing a displayed image during playback of a recorded television program and (2) a video recorder operable to store an image of a television program at a selected point during the television program.

34. The computer program product of claim 30, wherein the executable code for comparing the input image with the plurality of video files comprises:

executable code for determining text in the input image,

executable code for determining text in the plurality of video files; and

executable code for comparing the text in the input image to text in the video files to determine the video file that includes information that matches the input image.

35. The computer program product of claim 34, wherein the text in the input image corresponds to closed captioning information displayed at that point in the corresponding video file.

36. The computer program product of claim 30, wherein the executable code for determining the video file comprises:

executable code for determining temporal information associated with the input image; and

executable code for using the temporal information to determine the video file.

37. The computer program product of claim 30, further comprising executable code for determining a portion of the determined video file that includes information that matches the input image.

38. The computer program product of claim 30, further comprising executable code for performing an action with respect to the determined video file, the action comprising at least one of outputting, displaying, playing, storing, and sending the determined video file or an identified portion of the determined video file.