Content-Based Indexing and Retrieval Methods for Surround Video Synthesis

• US 20070141545A1
• Filed: 07/31/2006
• Published: 06/21/2007
• Est. Priority Date: 12/05/2005
• Status: Abandoned Application

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Bhattacharjya, Anoop K., Tan, Kar-Han
• Application Number:
  US11/461,407
• Publication Number:
  US 20070141545A1
• Time in Patent Office: Days
• US Class Current: 434/365
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4131 home appliance, e.g. lighting, air conditioning system, metering devices home automation data switching networks exchanging configuration information on appliance services H04L12/2807
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/432 Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 9/3179 Video signal processing therefor
• CPC Class Codes: H04N 9/74 for obtaining special effects H04N9/65 - H04N9/73 take precedence

Abstract

Systems and methods for synthesizing a surround visual field of image related to an input image are described. In one embodiment, the surround visual field is displayed in an area partially surrounding or surrounding an input image being displayed. In an embodiment, this surround visual field may comprise a plurality of images selected from a database of still images and/or video images based upon a characteristic or characteristics that relate to the displayed input image.

Claims

1. A system for displaying a surround field of related images comprising:

a database of images that is selectively searchable based upon at least one characteristic;

a surround visual field controller that obtains a characteristic of an input image, receives at least one image from the database of images that relates to the characteristic of the input image, and generates a surround visual field comprising the at least one image; and

a display device, communicatively coupled to the surround visual field controller, that displays the input image in a first area and displays the surround visual field in a second area that at least partially surrounds the first area.

2. The system of claim 1 wherein the surround visual field controller obtains a characteristic of the input image by analyzing the input image.

3. The system of claim 2 wherein the characteristic of the input image is related to the content of the input image.

4. The system of claim 1 wherein the database of images comprises video images and still images.

5. The system of claim 4 wherein the database is a content-based indexing and retrieval database, which is selectively searchable based upon a content-based characteristic.

6. The system of claim 5 wherein the content-based characteristic is at least one selected from the group comprising:

text-based information, auxiliary information, visual feature information, color information, motion vectors, compressed domain features, region shapes, edge orientation distributions, metadata information, time information, date information, content motion, and camera motion.

7. The system of claim 1 wherein the display device comprises a first display device that displays the input image in the first area and a second display device that displays the surround visual field in the second area.

8. A method of generating a surround visual field comprising at least one image that relates to an input image, the method comprising:

analyzing the input image to obtain a characteristic of the input image; and

selectively searching a database of images to obtain at least one image that relates to the characteristic of the input image;

synthesizing the at least one image into a surround visual field; and

displaying the input image in a first area and displaying the surround visual field in a second area that at least partially surrounds the first area.

9. The method of claim 8 wherein the step of analyzing the input image to obtain a characteristic of the input image comprises the step of:

using a content-based analysis technique to obtain a content-based characteristic as the characteristic.

10. The method of claim 9 wherein the content-based characteristic is at least one selected from the group comprising:

text-based information, auxiliary information, visual feature information, color information, motion vectors, compressed domain features, region shapes, edge orientation distributions, metadata information, time information, date information, content motion, and camera motion.

11. The method of claim 10 wherein the database of images is a content-based indexing and retrieval database.

12. The method of claim 8 wherein the at least one image that relates to the characteristic of the input image are ranked.

13. The method of claim 8 wherein the steps are repeated to update the surround visual field.

14. A computer-readable medium carrying one or more sequences of instructions which, when executed by one or more processors, cause the one or more processors to perform at least the steps of the method of claim 8.

15. A surround visual field controller comprising:

an input image analysis module, communicatively coupled to receive an input image, that analyzes the input image to obtain at least one characteristic of the input image;

a database interface, communicatively coupled to receive the at least one characteristic of the input image, that uses the characteristic to obtain from a database of images at least one image that relates to the input image characteristic; and

a surround visual field generator, communicatively coupled to receive the at least one image that relates to the input image characteristic, that synthesizes a surround visual field comprising the at least one image that relates to the input image characteristic, wherein the surround visual field is to be displayed in an area that at least partially surrounds a display of the input image.

16. The controller of claim 15 wherein the database of images comprises video images and still images.

17. The controller of claim 16 wherein the database of images is a content-based indexing and retrieval database, which is selectively searchable based upon a content-based characteristic.

18. The controller of claim 15 wherein the input image analysis module obtains the characteristic of the input image by using a content analysis technique to obtain a content-based characteristic.

19. The controller of claim 15 wherein the surround visual field generator synthesizes the surround visual field by modifying the at least one image that relates to the input image characteristic.

20. The controller of claim 19 wherein the at least one image that relates to the input image characteristic is modified by at least one of the group comprising:

stretching, rotating, tiling with another image, selecting a portion of the at least one image, and applying a degree of transparency to the at least one image.