Apparatus and method for outputting video Imagrs, and purchasing system

• US 20090083814A1
• Filed: 09/11/2008
• Published: 03/26/2009
• Est. Priority Date: 09/25/2007
• Status: Active Grant

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Sekine, Masahiro, Yamauchi, Yasunobu, Higuchi, Yasukazu, Mihara, Isao
• Granted Patent: US 8,466,961 B2
• Time in Patent Office: Days
• US Class Current: 725/104
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

The video input unit inputs video data. The reference data input unit inputs a plurality of reference data relating to the video data. The extraction condition determining unit determines, from the identification information of the plurality of reference data, an item of identification information in correspondence with a period of time elapsed after receipt of an output request. The reference data extracting unit extracts the reference data having the determined identification information. The analyzing unit calculates the level of similarity between the frames in the input video data and the reference data, and extracts frames whose level of similarity is greater than a first threshold value. The video generating unit generates output video data that includes the extracted frames. The output unit outputs the generated output video data.

Claims

1. A video outputting apparatus comprising:

a video input unit that inputs video data;

a reference data input unit that inputs a plurality of reference data formed from at least one of image data, text data, and speech data related to the input video data;

a determining unit that determines identification information corresponding to predetermined variable information that changes dynamically and includes an elapsed time elapsed after receipt of an output request of the output video data, from among identification information for the plurality of reference data in accordance with a predetermined rule;

a reference data extracting unit that extracts the reference data corresponding to the identification information determined from the plurality of reference data;

a frame extracting unit that calculates at least one of a level of similarity between frames in the input video data and the image data extracted as the reference data, a level of similarity between text data attached to the frames as metadata and the text data extracted as the reference data, and a level of similarity between speech data attached to the frames and the speech data extracted as the reference data, and extracts a frame whose calculated level of similarity is greater than a predetermined first threshold value or a frame to which speech data whose calculated level of similarity is greater than the first threshold value is attached;

a video generating unit that generates the output video data including the frame extracted by the frame extracting unit; and

an output unit that outputs the output video data generated by the video generating unit.

2. The apparatus according to claim 1, further comprising:

an analysis result judging unit that determines which data form the metadata attached to the frame and which data form the extracted reference data, from among forms of image data, text data, and speech data, and determines whether the data form of the metadata matches the data form of the reference data, wherein

the reference data extracting unit extracts the reference data that is in data form that matches the data form of the metadata, when the data form of the metadata does not match the data form of the reference data.

3. The apparatus according to claim 1, further comprising:

an analysis result judging unit that determines whether the number of the extracted frames is within a predetermined range, wherein

the reference data extracting unit further extracts reference data that is different from the reference data having the determined identification information, when the number of frames is not within a predetermined range.

4. The apparatus according to claim 1, wherein the video generating unit selects a frame of an attribute included in a predetermined generation condition from the extracted frames, based on the generation condition defining the attribute of the frames that are to be included in the output video data and an output mode, and generates the output video data that outputs the selected frames in the output mode included in the generation condition.

5. The apparatus according to claim 4, further comprising:

a generation result judging unit that determines whether the extracted frames include the frame of the attribute and/or whether the extracted frames include a frame that can be output in the output mode, wherein

the reference data extracting unit further extracts reference data that is different from the reference data having the determined identification information, when the extracted frames do not include the frame of the attribute and/or when the extracted frames do not include the frame that can be output in the output mode.

6. The apparatus according to claim 1, wherein the frame extracting unit further calculates at least one of a level of similarity between the frames in the input video data and frames included in the output video data, or a level of similarity between the speech data attached to the frames and speech data attached to the frames included in the output video data, and extracts a frame whose calculated level of similarity is greater than the first threshold value or the frame to which speech data whose calculated level of similarity is greater than the first threshold value is attached.

7. The apparatus according to claim 1, further comprising:

a history storage unit that stores the output video data every time the output video data is generated; and

a generation result judging unit that determines a level of similarity between output video data newly generated by the video generating unit and the output video data stored in the history storage unit, and determines whether the calculated level of similarity is greater than a predetermined second threshold value, wherein the reference data extracting unit further extracts reference data that is different from the reference data having the determined identification information, in accordance with a comparison between the calculated level of similarity and the second threshold value.

8. The apparatus according to claim 1, further comprising:

a reference data storage unit that stores the reference data in association with other items of the reference data related thereto, wherein

the reference data extracting unit further extracts the other reference data related to the extracted reference data, from the reference data storage unit.

9. The apparatus according to claim 1, further comprising:

an association information storage unit that stores association information in which a predetermined generation condition defining an attribute of the frames to be included in the output video data and an output mode is associated with a predetermined constraint condition relating to a viewing situation of the output video data;

a constraint input unit that inputs the constraint condition; and

a generation condition acquiring unit that acquires the generation condition corresponding to the input constraint condition, from the association information storage unit, wherein

the video generating unit selects a frame of the attribute included in the acquired generation condition from the extracted frames, and generates the output video data to output the selected frames in the output mode included in the acquired generation condition.

10. The apparatus according to claim 9, further comprising:

an analysis result judging unit that analyzes the extracted frames and acquires the constraint condition relating to the frames, wherein

the generation condition acquiring unit further acquires the generation condition corresponding to the acquired constraint condition from the association information storage unit.

11. The apparatus according to claim 9, further comprising:

a generation result judging unit that determines whether the extracted frames include the frame of the attribute included in the acquired generation condition and/or whether the extracted frames include the frame that can be output in the output mode included in the acquired generation condition, wherein

the generation condition acquiring unit acquires from the association information storage unit a generation condition that is different from the acquired generation condition, when the extracted frames do not include the frame of the attribute and/or when the extracted frames do not include the frame that can be, output in the output mode.

12. The apparatus according to claim 9, further comprising:

a history storage unit that stores the output video data each time the output video data is generated; and

a generation result judging unit that calculates a level of similarity between output video data that is newly generated by the video generating unit and the output video data stored in the history storage unit, and determines whether the calculated similarity is greater than a predetermined third threshold value, wherein

the generation condition acquiring unit further acquires from the association information storage unit the generation condition corresponding to a constraint condition that is different from the obtained constraint condition, in accordance with a comparison between the calculated level of similarity and the third threshold value.

13. The apparatus according to claim 1, further comprising:

a generation condition input unit that inputs a predetermined generation condition defining an attribute of the frames that are to be included in the output video data and an output mode, wherein

the video generating unit selects a frame of the attribute included in the input generation condition from the extracted frames, and generates the output video data that outputs the selected frame in the output mode included in the input generation condition.

14. The apparatus according to claim 1, wherein the output unit further outputs the extracted reference data and the generated output video data, in association with each other.

15. The apparatus according to claim 1, wherein

the output unit further displays the identification information in a designatable manner;

the apparatus further comprises an operating unit that designates at least one item of the identification information displayed by the output unit; and

the determining unit determines the item of the identification information designated by the operating unit as the identification information of the reference data that is to be extracted.

16. The apparatus according to claim 1, wherein

the video outputting apparatus is connected via network to a providing apparatus that provides video data related to a product and a charging apparatus that executes a charging process onto a provider of the product in accordance with purchase information of the purchased product;

the video input unit inputs the video data related to the product from the providing apparatus; and

the video outputting apparatus further comprises;

a purchase processing unit that executes a process relating to a purchase of the product designated with reference to the output video data output by the output unit; and

a charging processing unit that transmits to the charging apparatus the purchase information related to the product purchased on the purchase processing unit.

17. A video outputting method performed in a video outputting apparatus, the method comprising:

inputting video data;

inputting a plurality of reference data formed from at least one of image data, text data, and speech data related to the input video data;

determining identification information corresponding to predetermined variable information that changes dynamically and includes an elapsed time elapsed after receipt of an output request of the output video data, from among identification information for the plurality of reference data in accordance with a predetermined rule;

extracting the reference data corresponding to the identification information determined from the plurality of reference data;

calculating at least one of a level of similarity between frames in the input video data and the image data extracted as the reference data, a level of similarity between text data attached to the frames as metadata and the text data extracted as the reference data, and a level of similarity between speech data attached to the frames and the speech data extracted as the reference data;

extracting a frame whose calculated level of similarity is greater than a predetermined first threshold value or a frame to which speech data whose calculated level of similarity is greater than the first threshold value is attached;

generating the output video data including the extracted frame; and

outputting the generated output video data.

18. A purchasing system comprising:

a providing apparatus that provides video data related to a product;

a charging apparatus that executes a charging process onto a provider of the product in accordance with purchase information of the purchased product; and

a video outputting apparatus that generates and outputs output video data including frames extracted from input video data, wherein

the video outputting apparatus includes

a video input unit that inputs video data,

a reference data input unit that inputs a plurality of reference data formed from at least one of image data, text data, and speech data related to the input video data,

a determining unit that determines identification information corresponding to predetermined variable information that changes dynamically and includes an elapsed time elapsed after receipt of an output request of the output video data, from among identification information for the plurality of reference data in accordance with a predetermined rule,

a reference data extracting unit that extracts the reference data corresponding to the identification information determined from the plurality of reference data,

a frame extracting unit that calculates at least one of a level of similarity between frames in the input video data and the image data extracted as the reference data, a level of similarity between text data attached to the frames as metadata and the text data extracted as the reference data, and a level of similarity between speech data attached to the frames and the speech data extracted as the reference data, and extracts a frame whose calculated level of similarity is greater than a predetermined first threshold value or a frame to which speech data whose calculated level of similarity is greater than the first threshold value is attached,

a video generating unit that generates the output video data including the frame extracted by the frame extracting unit,

an output unit that outputs the output video data generated by the video generating unit,

a purchase processing unit that executes a process relating to a purchase of the product designated with reference to the output video data output by the output unit, and

a charging processing unit that transmits to the charging apparatus the purchase information related to the product purchased on the purchase processing unit.