PICTURE DETECTION DEVICE, PICTURE RECORDING DEVICE, PICTURE RECORDING/REPRODUCTION DEVICE, PICTURE DETECTION METHOD, PICTURE RECORDING METHOD, AND PICTURE RECORDING/REPRODUCTION METHOD

• US 20130156308A1
• Filed: 11/06/2012
• Published: 06/20/2013
• Est. Priority Date: 12/20/2011
• Status: Abandoned Application

• Current Assignee: Socionext Inc.
• Original Assignee: Fujitsu Semiconductor Limited (Fujitsu Limited)
• Inventors: ABE, Akio
• Application Number:
  US13/669,678
• Publication Number:
  US 20130156308A1
• Time in Patent Office: Days
• US Class Current: 382/165
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4858 for modifying screen layout parameters, e.g. fonts, size of the windows
• CPC Class Codes: H04N 21/488 Data services, e.g. news ticker systems specially adapted for using meteorological information in broadcast systems H04H60/71
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts

Abstract

A picture detection device includes an estimation unit configured to, based on deviations in color information of pixels of a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion, and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimate an edge portion of the picture frame in which the second picture is displayed from among above-described four portions; and a detection unit configured to detect the first picture of the picture flame; wherein the detection unit moves a borderline detection line from the center of the picture frame toward the estimated edge portion, and detects a borderline between the first picture and the second picture based on a brightness difference of pixels in the vicinity of the borderline detection line, and detects the first picture based on the detected borderline.

Claims

1. A picture detection device, comprising:

an estimation unit configured to, based on deviations in color information of pixels of a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion, and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimate an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion; and

a detection unit configured to detect the first picture of the picture flame;

wherein the detection unit moves a borderline detection line from the center of the picture frame toward the estimated edge portion, and detects a borderline between the first picture and the second picture based on a brightness difference of pixels in the vicinity of the borderline detection line, and detects the first picture based on the detected borderline.

2. The picture detection device according to claim 1, wherein

the pixel color information is a color difference, and

when the color differences of all pixels in a prescribed number of lines in the edge portion of the picture frame are the same, or when the ratio of the number of pixels approximating a color difference among all pixels in a prescribed number of lines in the edge portion of the picture frame to the number of all pixels is equal to or greater than a first threshold, the estimation unit estimates the edge portion of the picture frame to be a edge portion of the picture frame in which the second picture is displayed.

3. The picture detection device according to claim 1, wherein, when the color differences of a portion of pixels in a prescribed number of lines in the edge portion of the picture frame are the same, or when the ratio of the number of pixels approximating a color difference among a portion of pixels in a prescribed number of lines in the edge portion of the picture frame to the number of the portion of pixels is equal to or greater than a second threshold, the estimation unit estimates the edge portion of the picture frame to be a edge portion of the picture frame in which the second picture is displayed.

4. The picture detection device according to claim 1, wherein the detection unit moves a vertical-direction first borderline detection line in a horizontal direction from the center of the picture frame toward the estimated vertical-direction edge portion, and moves a horizontal-direction second borderline detection line in a vertical direction from the center of the picture frame toward the estimated horizontal-direction edge portion, and based on brightness differences of pixels in the vicinities of the first and second borderline detection lines, detects borderlines between the first picture and the second picture.

5. The picture detection device according to claim 4, wherein, when the detection unit detects a plurality of vertical-direction borderlines and also detects a plurality of horizontal-direction borderlines, based on the aspect ratio of the picture frame, the detection unit selects one among the plurality of vertical-direction borderlines and also selects one among the plurality of horizontal-direction borderlines and then detects the first picture having the aspect ratio.

6. The picture detection device according to claim 4, wherein, when the detection unit detects a plurality of vertical-direction borderlines and also detects one horizontal-direction borderline, based on the aspect ratio of the picture frame, the detection unit selects one among the plurality of vertical-direction borderlines and detects the first picture having the aspect ratio.

7. The picture detection device according to claim 4, wherein, when the detection unit detects a plurality of horizontal-direction borderlines and also detects one vertical-direction borderline, based on the aspect ratio of the picture frame, the detection unit selects one among the plurality of horizontal-direction borderlines and detects the first picture having the aspect ratio.

8. A picture recording device, comprising:

an estimation unit, configured to, based on deviations in color information of pixels of a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion, and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimates an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion;

a detection unit configured to detect the first picture of the picture flame; and

a recording unit configured to record on a recording medium a picture signal of the detected first picture;

wherein the detection unit moves a borderline detection line from the center of the picture frame toward the estimated edge portion, and detects a borderline between the first picture and the second picture based on a brightness difference of pixels in the vicinity of the borderline detection line, and detects the first picture based on the detected borderline.

9. A picture recording/reproduction device, comprising:

an estimation unit, configured to, based on deviations in color information of pixels of a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion, and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimates an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion;

a detection unit configured to move a borderline detection line from the center of the picture frame toward the estimated edge portion, detect a borderline between the first picture and the second picture based on a brightness difference of pixels in the vicinity of the borderline detection line, and detect the first picture based on the detected borderline;

a recording unit configured to record on a recording medium a picture signal of the picture frame in association with positional information of the detected borderline in the picture frame; and

a reproduction configured to reproduce the picture signal;

wherein

the detection unit configured to detect the first picture in the picture frame recorded on the recording medium, based on the positional information of the borderline recorded in association with the picture signal of the picture frame recorded on the recording medium; and

the reproduction unit configured to reproduce the picture signal of the detected first picture.

10. A picture detection method, comprising:

based on deviations in color information of pixels in a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimating an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion;

moving a borderline detection line from the center of the picture frame toward the estimated edge portion, and based on brightness differences of pixels in the vicinity of the borderline detection line, detecting a borderline between the first picture and the second picture; and

based on the detected borderline, detecting the first picture.

11. A picture recording method, comprising:

based on deviations in color information of pixels in a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimating an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion;

moving a borderline detection line from the center of the picture frame toward the estimated edge portion, and based on brightness differences of pixels in the vicinity of the borderline detection line, detecting a borderline between the first picture and the second picture;

based on the detected borderline, detecting the first picture; and

recording the picture signal of the detected first picture on a recording medium.

12. A picture recording/reproduction method, comprising:

based on deviations in color information of pixels in a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimating an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion;

moving a borderline detection line from the center of the picture frame toward the estimated edge portion, and based on brightness differences of pixels in the vicinity of the borderline detection line, detecting a borderline between the first picture and the second picture;

recording the picture signal of the picture frame in association with positional information of the detected borderline in the picture frame on a recording medium;

based on the positional information of the borderline recorded in association with a picture signal of the picture frame recorded on the recording medium,

detecting a first picture in the picture frame recorded on the recording medium; and

reproducing the picture signal of the detected first picture.