Playback time compression and expansion method and apparatus

• US 6,370,315 B1
• Filed: 04/29/1999
• Issued: 04/09/2002
• Est. Priority Date: 04/30/1998
• Status: Expired due to Fees

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Mizuno, Toshio
• Primary Examiner(s): Garber, Wendy R.
• Assistant Examiner(s): ONUAKU, CHRISTOPHER O
• Application Number:
  US09/301,310
• Time in Patent Office: 1,076 Days
• Field of Search: 386/1, 386/33, 386/45, 386/67-68, 386/111-112, 386/125-126, 348/416.1, 348/699, 348/700, 375/240.16, 375/240.12, 382/239, 382/236
• US Class Current: 386/241
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/036 Insert-editing

Abstract

The playback time of a video stream can be expanded by outputting twice frames having a low rate of video change and a low audio level, and the playback time can be compressed by dropping frames having a low rate of video change and a low audio level. The playback time can thus be increased or decreased easily and in a short time compared with methods in which the playback time is increased or decreased by re-editing. The viewer also perceives less unnatural video or audio compared with methods in which the playback time is increased or decreased by varying the playback speed because there is no slowing of image motion with an accompanying drop in audio pitch, nor is there a quickening of image motion with an accompanying rise in audio pitch.

Claims

1. A playback time expansion method for lengthening a playback time of digitized video, comprising:

a step for measuring a rate of video change for all frames in the digitized video,

said rate of video change indicating how much video in a particular frame has changed compared with video in a frame before and a frame after;

a step for recording said video;

a step for calculating a number of manipulation frames based on a playback time before said video playback time expansion and a playback time after said video playback time expansion,

said number of manipulation frames indicating a number of frames to be manipulated in the total number of frames in said video;

a step for selecting a number of frames equal to said number of manipulation frames from among all frames in said video in sequence from the lowest rate of video change; and

a step for outputting recorded video;

wherein said step for outputting recorded video is characterized by manipulating said selected frames such that the video of each selected frame is output a plurality of times.

2. The playback time expansion method as set forth in claim 1, wherein digitized audio is associated with said video, said method further comprises:

a step for measuring an audio level for every frame in said video, and

said step for frame selection is characterized by selecting frames with priority for frames in which said audio level is below a predetermined level.

3. The playback time expansion method as set forth in claim 1, further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block.

4. The playback time expansion method as set forth in claim 1, further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block and any block adjacent thereto.

5. The playback time expansion method as set forth in claim 1, further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting frames equally from said plurality of blocks.

6. A playback time compression method for shortening a playback time of digitized video, comprising:

a step for measuring a rate of video change for all frames in the digitized video,

said rate of video change indicating how much video in a particular frame has changed compared with video in a frame before and a frame after;

a step for recording said video;

a step for calculating a number of manipulation frames based on a playback time before said video playback time compression and a playback time after said video playback time compression,

said number of manipulation frames indicating a number of frames to be manipulated in the total number of frames in said video;

a step for selecting a number of frames equal to said number of manipulation frames from among all frames in said video in sequence from the lowest rate of video change; and

a step for outputting recorded video;

wherein said step for outputting recorded video is characterized by manipulating said selected frames such that the video of each selected frame is not output.

7. The playback time compression method as set forth in claim 6, wherein digitized audio is associated with said video, said method further comprises:

a step for measuring an audio level for every frame in said video, and

said step for frame selection is characterized by selecting frames with priority for frames in which said audio level is below a predetermined level.

8. The playback time compression method as set forth in claim 6, further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block.

9. The playback time compression method as set forth in claim 6, further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block and any block adjacent thereto.

10. The playback time compression method as set forth in claim 6, further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting frames equally from said plurality of blocks.

11. A playback time expansion apparatus for lengthening a playback time of digitized video, comprising:

rate of video change measuring means for measuring a rate of video change for all frames in the digitized video,

said rate of video change indicating how much video in a particular frame has changed compared with video in a frame before and a frame after;

recording means for recording said video;

calculating means for calculating a number of manipulation frames based on a playback time before said video playback time expansion and a playback time after said video playback time expansion,

said number of manipulation frames indicating a number of frames to be manipulated in the total number of frames in said video;

frame selecting means for selecting a number of frames equal to said number of manipulation frames from among all frames in said video in sequence from the lowest rate of video change; and

output means for outputting video recorded by the recording means;

wherein said output means is characterized by manipulating said selected frames during video output such that the video of each frame selected by said frame selecting means is output a plurality of times.

12. The playback time expansion apparatus as set forth in claim 11, wherein digitized audio is associated with said video, said apparatus further comprises:

audio level measuring means for measuring an audio level for every frame in said video, and

said frame selecting means is characterized by selecting frames with priority for frames in which said audio level is below a predetermined level.

13. The playback time expansion apparatus as set forth in claim 11, further comprising:

means for segmenting the total number of frames in said video into a plurality of blocks;

wherein said frame selecting means is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block.

14. The playback time expansion apparatus as set forth in claim 11, further comprising:

means for segmenting the total number of frames in said video into a plurality of blocks;

wherein said frame selecting means is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block and any block adjacent thereto.

15. The playback time expansion apparatus as set forth in claim 11, further comprising:

means for segmenting the total number of frames in said video into a plurality of blocks;

wherein said frame selecting means is characterized by selecting frames equally from said plurality of blocks.

16. A playback time compression apparatus for shortening a playback time of digitized video, comprising:

rate of video change measuring means for measuring a rate of video change for all frames in the digitized video,

said rate of video change indicating how much video in a particular frame has changed compared with video in a frame before and a frame after;

recording means for recording said video;

calculating means for calculating a number of manipulation frames based on a playback time before said video playback time compression and a playback time after said video playback time compression,

said number of manipulation frames indicating a number of frames to be manipulated in the total number of frames in said video;

frame selecting means for selecting a number of frames equal to said number of manipulation frames from among all frames in said video in sequence from the lowest rate of video change; and

output means for outputting video recorded by the recording means;

wherein said output means is characterized by manipulating said selected frames during video output such that the video of each frame selected by said frame selecting means is not output.

17. The playback time compression apparatus as set forth in claim 16, wherein digitized audio is associated with said video, said apparatus further comprises:

audio level measuring means for measuring an audio level for every frame in said video, and

said frame selecting means is characterized by selecting frames with priority for frames in which said audio level is below a predetermined level.

18. The playback time compression apparatus as set forth in claim 16, further comprising:

means for segmenting the total number of frames in said video into a plurality of blocks;

wherein said frame selecting means is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block.

19. The playback time compression apparatus as set forth in claim 16, further comprising:

means for segmenting the total number of frames in said video into a plurality of blocks;

wherein said frame selecting means is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block and any block adjacent thereto.

20. The playback time compression apparatus as set forth in claim 16, further comprising:

means for segmenting the total number of frames in said video into a plurality of blocks;

wherein said frame selecting means is characterized by selecting frames equally from said plurality of blocks.

21. A recording medium for recording a computer executable program achieving an operating environment for lengthening a playback time of digitized video, said program comprising:

a step for measuring a rate of video change for all frames in the digitized video,

said rate of video change indicating how much video in a particular frame has changed compared with video in a frame before and a frame after;

a step for recording said video;

a step for calculating a number of manipulation frames based on a playback time before said video playback time expansion and a playback time after said video playback time expansion,

said number of manipulation frames indicating a number of frames to be manipulated in the total number of frames in said video;

a step for selecting a number of frames equal to said number of manipulation frames from among all frames in said video in sequence from the lowest rate of video change; and

a step for outputting recorded video;

wherein said step for outputting recorded video is characterized by manipulating said selected frames such that the video of each selected frame is output a plurality of times.

22. The recording medium as set forth in claim 21 for recording a computer executable program achieving an operating environment wherein digitized audio is associated with said video, and said program further comprises:

a step for measuring an audio level for every frame in said video, and

said step for frame selection is characterized by selecting frames with priority for frames in which said audio level is below a predetermined level.

23. The recording medium as set forth in claim 21 for recording a computer executable program achieving an operating environment further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block.

24. The recording medium as set forth in claim 21 for recording a computer executable program achieving an operating environment further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block and any block adjacent thereto.

25. The recording medium as set forth in claim 21 for recording a computer executable program achieving an operating environment further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting frames equally from said plurality of blocks.

26. A recording medium for recording a computer executable program achieving an operating environment for shortening a playback time of digitized video, said program comprising:

a step for measuring a rate of video change for all frames in the digitized video,

said rate of video change indicating how much video in a particular frame has changed compared with video in a frame before and a frame after;

a step for recording said video;

a step for calculating a number of manipulation frames based on a playback time before said video playback time compression and a playback time after said video playback time compression,

said number of manipulation frames indicating a number of frames to be manipulated in the total number of frames in said video;

a step for selecting a number of frames equal to said number of manipulation frames from among all frames in said video in sequence from the lowest rate of video change; and

a step for outputting recorded video;

wherein said step for outputting recorded video is characterized by manipulating said selected frames such that the video of each selected frame is not output.

27. The recording medium as set forth in claim 26 for recording a computer executable program achieving an operating environment wherein digitized audio is associated with said video, and said program further comprises:

a step for measuring an audio level for every frame in said video, and

said step for frame selection is characterized by selecting frames with priority for frames in which said audio level is below a predetermined level.

28. The recording medium as set forth in claim 26 for recording a computer executable program achieving an operating environment further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block.

29. The recording medium as set forth in claim 26 for recording a computer executable program achieving an operating environment further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting a frame from one of a plurality of said blocks, and then selecting a next frame from a block other than said one block and any block adjacent thereto.

30. The recording medium as set forth in claim 26 for recording a computer executable program achieving an operating environment further comprising:

a step for segmenting the total number of frames in said video into a plurality of blocks;

wherein said step for frame selection is characterized by selecting frames equally from said plurality of blocks.

31. A playback time expansion and compression method for lengthening or shortening a playback time of digitized video, comprising:

a step for measuring a rate of video change for all frames in the digitized video,

said rate of video change indicating how much video in a particular frame has changed compared with video in a frame before and a frame after;

a step for recording said video;

a step for determining a manipulation sequence number for every frame in said video in relation to said rate of video change,

said manipulation sequence number indicating a sequence in which said frames are to be manipulated;

a step for compiling a table recording said manipulation sequence numbers;

a step for calculating a number of manipulation frames based on a playback time before said video playback time expansion/compression and a playback time after said video playback time expansion/compression,

said number of manipulation frames indicating a number of frames to be manipulated in the total number of frames in said video;

a step for selecting, in reference to said table, a number of frames equal to said number of manipulation frames from among all frames in said video in sequence from the lowest rate of video change; and

a step for outputting recorded video;

wherein said step for outputting recorded video is characterized by manipulating said selected frames such that

when said playback time is lengthened, the video of each selected frame is output a plurality of times, and

when said playback time is shortened, the video of each selected frame is not output.