IMAGE GENERATION DEVICE AND IMAGE GENERATION METHOD

• US 20150162048A1
• Filed: 06/11/2012
• Published: 06/11/2015
• Est. Priority Date: 06/11/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Hirata, Shinichi, Osawa, Hiroshi, Furumura, Kyoko
• Granted Patent: US 9,583,133 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G11B 20/10527 Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2020/10592 specifically adapted for recording or reproducing multichannel signals
• CPC Class Codes: H04N 1/21 Intermediate information storage H04N1/387, H04N1/41 take precedence ; for control between transmitter and receiver or between image input and image output device H04N1/32358; indexing, editing G11B27/00
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/651 for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 9/87 Regeneration of colour television signals H04N9/80 takes precedence

Abstract

Frame memories store captured images supplied from a plurality of imaging units, respectively. A motion detection portion detects the motion of a captured image of at least one of the imaging units. A mode determination portion sets, in accordance with at least either the amount of the motion detected by the motion detection portion or a power consumption limit of the image generation device, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently. A control signal generation portion supplies, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the mode set by the mode determination portion.

Claims

1. An image generation device comprising:

a plurality of frame memories adapted to store captured images from a plurality of imaging units; and

a multiplexing section adapted to read the captured images of the imaging units from the frame memories and multiplex the captured images to generate an image stream,

wherein the multiplexing section includes

a motion detection portion adapted to detect a motion of a captured image of at least one of the imaging units,

a mode determination portion adapted to set, in accordance with at least either an amount of the motion detected by the motion detection portion or a power consumption limit of the image generation device, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently, and

a control signal generation portion adapted to supply, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the mode set by the mode determination portion.

2. The image generation device of claim 1 further comprising

a shooting control section adapted to control operations of the plurality of imaging units,

wherein the shooting control section supplies, to the plurality of imaging units, a control signal adapted to operate the plurality of imaging units simultaneously or intermittently in accordance with the mode set by the mode determination portion.

3. The image generation device of claim 2,

wherein, even when the mode for operating the plurality of imaging units intermittently is set by the mode determination portion, the control signal generation portion supplies, to the plurality of frame memories, a control signal adapted to operate the plurality of frame memories intermittently while operating the plurality of imaging units simultaneously.

4. The image generation device of claim 1, wherein

the mode determination portion sets the mode for operating the plurality of imaging units simultaneously if the amount of the motion detected by the motion detection portion is equal to or greater than a given threshold, and

the mode determination portion sets the mode for operating the plurality of imaging units intermittently if the amount of the motion detected by the motion detection portion is smaller than the given threshold.

5. The image generation device of claim 4, wherein,

even if the amount of the motion detected by the motion detection portion is equal to or greater than the given threshold, but if the image generation device is not operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units intermittently, and

if the amount of the motion detected by the motion detection portion is equal to or greater than the given threshold, and if the image generation device is operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units simultaneously.

6. The image generation device of claim 1, wherein,

if the image generation device is operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units simultaneously, and

if the image generation device is not operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units intermittently.

7. The image generation device of claim 1, wherein,

if the image generation device is operating on power from an external power source, the mode determination portion sets the mode for operating the plurality of imaging units simultaneously, and

if the image generation device is operating on power from a built-in chargeable battery, the mode determination portion sets the mode for operating the plurality of imaging units intermittently.

8. An image generation method comprising:

storing captured images from a plurality of imaging units in a plurality of frame memories; and

reading the captured images of the imaging units from the frame memories and multiplexing the captured images to generate an image stream,

wherein the reading includes

detecting a motion of a captured image of at least one of the imaging units,

setting, in accordance with at least either an amount of the detected motion or a power consumption limit, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently, and

supplying, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the set mode.

9. A non-transitory, computer-readable recording medium storing a program for a computer, the program comprising:

a module configured to store captured images from a plurality of imaging units in a plurality of frame memories; and

a module configured to read the captured images of the imaging units from the frame memories and multiplexing the captured images to generate an image stream,

wherein the module configured to read includes

a module configured to detect a motion of a captured image of at least one of the imaging units,

a module configured to set, in accordance with at least either an amount of the detected motion or a power consumption limit, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently, and

a module configured to supply, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the set mode.