Video processing apparatus, camera apparatus, video processing method, and program

• US 9,762,816 B2
• Filed: 05/29/2015
• Issued: 09/12/2017
• Est. Priority Date: 12/14/2010
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Ogino, Ryoji
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): Le, Tuan
• Application Number:
  US14/725,562
• Publication Number:
  US 20150264275A1
• Time in Patent Office: 837 Days
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A video processing apparatus analyzes an input video input from a video input unit, detects a plurality of moving bodies included in the input video, determines a main moving body and a sub moving body, and determines a sub picture position for superimposing and displaying a sub video in a main video in a picture-in-picture form. This video processing apparatus performs cut-out processing on the main video and the sub video from the input video, and synthesizes the cut-out main video and sub video to generate a picture-in-picture synthesized video in which the sub video is superimposed at the sub picture position of the main video in the picture-in-picture form. The picture-in-picture synthesized video is output in one stream.

Claims

1. A video processing apparatus, comprising:

a memory; and

a video processor that executes a program such that the processor performs video processing operations, including

receiving an input video;

determining one main moving body and at least one sub moving body from among a plurality of moving bodies when a plurality of moving bodies is detected in the input video input;

cutting out a main video showing the main moving body and a sub video showing the sub moving body from the input video, when a distance between the detected main moving body and the sub moving body is greater than a predetermined value, and preparing a single video showing the main moving body and the sub moving body; and

generating a picture-in-picture synthesized video that superimposes the single video including the main video and the sub video on the main video.

2. The video processing apparatus according to claim 1,

wherein the main moving body is designated by a user.

3. A video processing method, comprising:

receiving an input video taken by a camera;

detecting a plurality of moving bodies including a main moving body and a sub moving body included in the input video;

displaying a picture-in-picture video when a distance between the detected main moving body and the sub moving body is greater than a predetermined value, wherein the picture-in-picture video comprises a main video showing the detected main moving body and a sub video showing the detected sub moving body and superposed on the main video; and

displaying a single video when the distance between the detected main moving body and the sub moving body is equal to or less than the predetermined value, wherein the single video shows the detected main moving body and the sub moving body.

4. The video processing method according to claim 3, further comprising:

generating the main video showing the main moving body and corresponding to a first partial area of the input image;

generating the sub video showing the sub moving body and corresponding to a second partial area of the input image; and

generating the picture-in-picture video by superposing and synthesizing the sub video on the main video.

5. The video processing method according to claim 4, further comprising:

determining a position of the sub video with respect to the main video in accordance with a position of the sub moving body in the input video; and

outputting the picture-in-picture video in a one stream.

6. The video processing method according to claim 3, further comprising:

switching to display the single video when the distance changes equal to or less than the predetermined value by the main moving body moving or the sub moving body moving during displaying the picture-in-picture video.

7. The video processing method according to claim 3, further comprising:

switching to display the picture-in-picture video when the distance changes greater than the predetermined value by the main moving body moving or the sub moving body moving during displaying the single video.

8. The video processing method according to claim 3, further comprising:

zooming-in or zooming-out the main video of the picture-in-picture video in response to a change of the distance between the detected the main moving body and the sub moving body by the main moving body moving or the sub main moving body moving.

9. The video processing method according to claim 3, further comprising:

zooming-out the main video of the picture-in-picture video so that the main video includes the sub moving body when the distance between the detected the main moving body and the sub moving body is equal to or less than the predetermined value.

10. The video processing method according to claim 9, further comprising:

aligning a position of the sub video in the picture-in-picture video with a position of the sub moving body in the zoomed-out main video.

11. The video processing method according to claim 9, further comprising:

switching to display the single video from the picture-in-picture video after aligning a position of the sub video in the picture-in-picture video with a position of the sub moving body in the zoomed out main video.

12. The video processing method according to claim 3, further comprising:

zooming-in the main video of the picture-in-picture video after switching to display the picture-in-picture video from the single video.

13. The video processing method according to claim 3, further comprising:

determining the sub moving body as a new main moving body;

determining the main moving body as a new sub moving body; and

then displaying a new picture-in-picture video that comprises a new main video showing the new main moving body corresponding to the sub moving body and a new sub video showing the new sub moving body corresponding to the main moving body and superposed on the new main video.