IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD AND IMAGE PROCESSING SYSTEM

• US 20100091139A1
• Filed: 02/18/2008
• Published: 04/15/2010
• Est. Priority Date: 03/12/2007
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Hosoda, Yasuhide, Sugino, Akinobu, Sano, Akane, Tsuruta, Masaaki, Ozaki, Nozomu, Sako, Yoichiro, Ito, Taiji, Sekizawa, Hidehiko, Asukai, Masamichi, Ebisawa, Kan, Kawakami, Itaru
• Application Number:
  US12/450,130
• Publication Number:
  US 20100091139A1
• Time in Patent Office: Days
• US Class Current: 348/231.99
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: H04N 1/3871 the composed originals being of different kinds, e.g. low- and high-resolution originals
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/2723 Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement data processing systems or methods specially adapted for marketing G06Q30/02

Abstract

A replacement area is set within an image expressed with captured image data. A pixel area with image content that can be processed without greatly altering the entire image content, for instance, may be designated as the replacement area. Replacement image data are generated by executing processing for replacing all of or part of the pixel data in the replacement area with insertion image data. The insertion image data are image data containing text, graphics or the like, such as an advertisement, a message or a translation. Consequently, various types of information can be provided in the replacement image data, a message from the user can be incorporated in the replacement image data, or better user convenience can be assured through the replacement image data.

Claims

1. An image processing apparatus comprising:

a captured image acquisition unit that obtains captured image data;

an insertion image storage unit that stores insertion image data;

a replacement area setting unit that sets a replacement area within an image of the captured image data obtained by the captured image acquisition unit; and

a replacement image generation unit that generates replacement image data by executing processing for replacing all of or part of pixel data within the replacement area with the insertion image data read out from the insertion image storage unit.

2. The image processing apparatus according to claim 1, wherein the captured image acquisition unit includes an imaging unit that captures an image, and obtains the captured image data by image capturing at the imaging unit.

3. The image processing apparatus according to claim 2, wherein the imaging unit is constituted with a CCD sensor or a CMOS sensor for an image sensor.

4. The image processing apparatus according to claim 1, wherein the captured image acquisition unit includes a communication unit that communicates with an external communication device, and obtains the captured image data by receiving the captured data through communication of the communication unit with the external communication device.

5. The image processing apparatus according to claim 1, wherein the captured image acquisition unit includes a reproduction unit that reproduces information from a portable recording medium, and obtains the captured image data by reproduction of the portable recording medium via the reproduction unit.

6. The image processing apparatus according to claim 1, having:

a communication unit that communicates with an external communication device, wherein

the insertion image storage unit stores the insertion image data transmitted from the external communication device and received at the communication unit.

7. The image processing apparatus according to claim 1, further comprising:

a save processing unit that executes save processing for the replacement image data generated by said replacement image generation unit and/or information of the replacement area set by the replacement area setting unit.

8. The image processing apparatus according to claim 7, wherein the save processing unit includes a recording unit that records information into a recording medium, and for the save processing, records the replacement image data and/or the replacement area information into the recording medium.

9. The image processing apparatus according to claim 7, wherein the save processing unit includes a communication unit that communicates with an external communication device, and for the save processing, transmits the replacement image data and/or the information of the replacement area to the external communication device.

10. The image processing apparatus according to claim 1, further comprising:

an image output unit that executes output processing for the replacement image data generated by the replacement image generation unit.

11. The image processing apparatus according to claim 10, wherein the image output unit includes a display unit and, for the output processing, display-outputs the replacement image data at the display unit.

12. The image processing apparatus according to claim 10, wherein the image output unit includes a communication unit that communicates with an external communication device, and for the output processing, transmit-outputs the replacement image data to the external communication device via the communication unit.

13. The image processing apparatus according to claim 10, wherein the image output unit includes a recording unit that records information into a portable recording medium, and for the output processing, records the replacement image data into the portable recording medium by the recording unit.

14. The image processing apparatus according to claim 1, wherein the replacement area setting unit detects a specific image within the captured image data by image analysis processing on the captured image data and sets the replacement area based upon the detected image.

15. The image processing apparatus according to claim 1, wherein the insertion image data is an advertising image, a message text image or a translation text image.

16. An image processing method comprising acts of:

obtaining captured image data;

setting a replacement area within an image of the obtained captured image data;

reading out stored insertion image data; and

generating replacement image data by replacing all or part of pixel data within the replacement area with the read out insertion image data.

17. An image processing system comprising:

an image processing apparatus; and

a server device configured to communicate with the image processing apparatus,

wherein

the image processing apparatus includes

a captured image acquisition unit that obtains captured image data,

a reception unit that receives insertion image data transmitted from the server device,

an insertion image storage unit that stores the insertion image data received at the reception unit,

a replacement area setting unit that sets a replacement area within an image of the captured image data obtained by the captured image acquisition unit, and

a replacement image generation unit that generates replacement image data by executing processing for replacing all of or part of pixel data within the replacement area with the insertion image data read out from the insertion image storage unit, and the server device includes

a transmission unit that transmits the insertion image data to the image processing apparatus.

18. An image processing apparatus comprising:

a captured image acquisition unit that obtains captured image data;

a replacement area setting unit that sets a replacement area within an image of the captured image data obtained by the captured image acquisition unit; and

a save processing unit that executes save processing for the captured image data and information of the replacement area set by the replacement area setting unit.

19. An image processing apparatus comprising:

a recording/reproduction unit that records and reproduces captured image data and information of a replacement area set for the captured image data by correlating the captured image data and the information of the replacement area to each other;

an insertion image storage unit that stores insertion image data; and

a replacement image generation unit that generates replacement image data by obtaining the captured image data and the information of the replacement area from the recording/reproduction unit and executing processing on the obtained captured image data for replacing all of or part of pixel data within the replacement area indicated by the information of the replacement area with the insertion image data read out from the insertion image storage unit.