Display apparatus and computer program

• US 8,022,988 B2
• Filed: 09/29/2004
• Issued: 09/20/2011
• Est. Priority Date: 09/29/2003
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Sugimoto, Yusuke, Kikuchi, Hiroaki, Noguchi, Yukinori, Kaku, Toshihiko
• Primary Examiner(s): Vo; Tung
• Assistant Examiner(s): Holder; Anner
• Application Number:
  US10/951,637
• Publication Number:
  US 20050093977A1
• Time in Patent Office: 2,547 Days
• Field of Search: 348/157, 725/38, 725/42, 725/53
• US Class Current: 348/157
• CPC Class Codes: G06T 2207/30221 Sports video; Sports image
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/4331 Caching operations, e.g. of an advertisement for later insertion during playback
• CPC Class Codes: H04N 21/4383 Accessing a communication channel
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 5/45 Picture in picture , e.g. displaying simultaneously another television channel in a region of the screen
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

A display apparatus includes an object recognizing unit for receiving a plurality of video channels and recognizing at least one object moving in the video channels, a display unit for displaying the plurality of video channels so that at east one of the objects recognized by the object recognizing unit is selectable, and if receiving a selection of an object, to which a user pays attention, displaying the video channel including the attention object as an attention object, considering the selected object as the attention object, a frame in and/or out detecting unit for detecting frame-out of the attention object out of the tracking video, and a video searching unit for searching other video channels using the attention object as a searching key if the frame-out of the attention object is detected and allowing the display unit to display the detected video channel.

Claims

1. A display apparatus for receiving video information including a plurality of video channels and selecting and displaying at least one of said plurality of video channels, compressing:

an object recognizing unit for receiving a plurality of video channels which are photographed from different positions or angles in an event with a plurality of cameras and recognizing at least one object moving in said video channels;

a display unit for displaying said plurality of video channels so that at least one of said objects recognized by said object recognizing unit is selectable and receiving a selection of an object, to which a user pays attention, considering said object selected as an attention object;

a video searching unit for searching said plurality of video channels using said attention object received by said display unit as a searching key and allowing said display unit to display one of said video channels, which includes said attention object, as a tracking video prior to other video channels; and

a frame-out detecting unit for detecting frame-out of said attention object out of said tracking video,

wherein if said frame-out detecting unit detects said frame-out of said attention object, said video searching unit searches other video channels using said attention object as a searching key and allows said display unit to display one of said video channels searched as said tracking video.

2. A display apparatus as claimed in claim 1, further comprising a frame-in detecting unit for detecting frame-in of a display prohibition object into a filtered video,

wherein said display unit receives a selection of an object, which a user does not desire to see, considering said object selected as said display prohibition object,

said video searching unit searches said plurality of video channels using said display prohibition object received by said display unit as a searching key and allows said display unit to display one of said video channels, which does not include said display prohibition object, as said filtered video-prior to other video channels, and

if said frame-in detecting unit detects said frame-in of said display prohibition object, said video searching unit searches other video channels using said display prohibition object as a searching key and allows said display unit to display one of said video channels, which does not include said display prohibition object, as said filtered video.

3. A display apparatus as claimed in claim 2, wherein said frame-in detecting unit detects frame-in of said display prohibition object into said filtered video with regard to a range outside said filtered video displayed by said display unit.

4. A display apparatus as claimed in claim 1, wherein said frame-out detecting unit detects whether or not said attention object is positioned out of a frame, which is set inside a display range of said tracking video with regard to said display unit.

5. A display apparatus as claimed in claim 1, further comprising a video preserving unit for preserving said plurality of video channels, after recording a timing at which said attention object is shown, for each of said plurality of video channels,

wherein said display unit retrieves said timing recorded in said video preserving unit and sequentially selects and reproduces one of said plurality of video channels showing said attention object.

6. A display apparatus as claimed in claim 5, wherein said display unit reproduces said video channels with a predetermined time lag from the time of receiving said video information, and if no video channels show said attention object during reproduction, said display unit selects and reproduces one of said video channels to show said attention object next time, using information obtained by retrieving said timing.

7. A display apparatus as claimed in claim 1, wherein said display unit attaches an identifier to each of said objects recognized by said object recognizing unit to display said object and receives an input of said identifier as said selection of said object.

8. A display apparatus as claimed in claim 1, wherein said display unit overlaps said tracking video onto an area, which is a part of one of said plurality of video channels attached with a voice comment, and displays said tracking video to be smaller than said video channel attached with said voice comment.

9. A display apparatus as claimed in claim 1, wherein if said attention object is shown in at least two of said video channels at the same time, said display unit selects and displays one of said video channels, in which the size of said object is larger than other video channels.

10. A display apparatus as claimed in claim 1, wherein if said attention object is shown in at least two of said video channels at the same time, said display unit selects and displays one of said video channels, in which the position of said object is closer to a centre than other video channels.

11. A display apparatus as claimed in claim 1, wherein if said attention object is shown in at least two of said video channels at the same time, said display unit selects and displays one of said video channels, in which said object faces a front relatively to other video channels.

12. A display apparatus as claimed in claim 1, wherein priority is given to each of said plurality of video channels in advance, and if said attention object is shown in at least two of said video channels at the same time, said display unit selects and displays one of said video channels, in which said priority is high.

13. A display apparatus as claimed in claim 1, wherein said video searching unit regularly evaluates each of said video channels with a plurality of evaluation items, and if said frame-out detecting unit detects said frame-out of said attention object, said video searching unit displays one of said video channels, in which a total value of said evaluation items is high, prior to other video channels.

14. A display apparatus as claimed in claim 1, wherein said video information is a broadcast.

19. The apparatus of claim 1, wherein frame-out of the attention object occurs when the attention object is completely not visible in the tracking video.

15. A display apparatus comprising:

a video preserving unit for preserving a plurality of video channels which are photographed from different positions or angles in an event with a plurality of cameras;

an object recognizing unit for receiving said plurality of video channels from said video preserving unit and recognizing at least one object moving in said video channels;

a display unit for displaying said plurality of video channels so that at least one of said objects recognized by said object recognizing unit is selectable, and if receiving a selection of an object, displaying one of said video channels including an attention object, to which a user pays attention, as a tracking video prior to other video channels;

a frame-out detecting unit for detecting frame-out of said attention object out of said tracking video; and

a video searching unit for searching other video channels using said attention object as a searching key if said frame-out of said attention object is detected, and allowing said display unit to display one of said video channels searched as said tracking video.

16. A non-transitory computer readable medium storing thereon a program for a display apparatus for receiving video information including a plurality of video images and selecting and displaying at least one of said plurality of video images, said program comprising computer-readable instructions for allowing said display apparatus to realize:

an object recognizing function for receiving said plurality of video images which are photographed from different positions or angles in an event with a plurality of cameras and recognizing at least one object moving in said video images;

a display function for displaying said plurality of video images so that at least one of said objects recognized by said object recognizing function is selectable, and if receiving a selection of an object, displaying one of said video images

including an attention object, to which a user pays attention, as a tracking video prior to other video images;

a frame-out detecting function for detecting frame-out of said attention object out of said tracking video; and

a video searching function for searching other video images using said attention object as a searching key if said frame-out of said attention object is detected, and allowing said display apparatus to display one of said video images searched as said tracking video.

17. The non-transitory computer readable medium as claimed in claim 16, wherein said object recognizing function is also for receiving the plurality of video images through a plurality of video channels.

18. The non-transitory computer readable medium as claimed in claim 16, wherein said computer-readable instructions allow said display apparatus to further realize a video preserving function for receiving the plurality of video images through a plurality of video channels and preserving the plurality of video images.