Image processor, image processing method, recording medium, computer program and semiconductor device

• US 7,176,945 B2
• Filed: 06/21/2004
• Issued: 02/13/2007
• Est. Priority Date: 10/06/2000
• Status: Expired due to Term

• Current Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Ohba, Akio
• Primary Examiner(s): Chauhan; Ulka
• Assistant Examiner(s): Washburn; Daniel C.
• Application Number:
  US10/872,917
• Publication Number:
  US 20040233224A1
• Time in Patent Office: 967 Days
• Field of Search: 345/629, 345/633, 345/634, 382/103
• US Class Current: 345/629
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

An image processor is provided which utilizes images taken by an imaging device, e.g., a digital camera, as an input interface to enter commands, etc. Such image processor includes a memory operable to store an image from a series of real time images of a location captured by an imaging device over time, the stored image at least partially including a target that is subject to movement from one point in the time to another point in the time. The image processor further includes a detector operable to detect the target and a movement component thereof by detecting features of the captured images at different points in the time, and includes an image generator operable to generate an object image representing a predetermined object so that a color of a predetermined portion of the object image varies according to the detected movement component of the target. Such image generator is further operable to generate a combined image from the object image and the stored image and to output in real time a signal representing the combined image, to permit the combined image to be displayed to the location imaged by the imaging device.

Claims

1. An image processor, comprising:

(a) a memory operable to store in real time a series of images of a location captured by an imaging device over time, the captured series of images at least partially including a target that is subject to move within the captured series of images from one point in the time to another point in the time;

(b) a detector operable to detect the target and a quantitative value of a movement component thereof by detecting differences between features of the captured series of images at a first point in the time and at a second point in the time;

(c) an image generator operable to generate an object image representing a predetermined object so that a color of a predetermined portion of the object image varies according to the detected quantitative value of the movement component of the target, the image generator being further operable to generate a combined image from the object image and an image from the captured series of images; and

(d) an output operable to output in real time a signal representing the combined image at the location captured in the series of images.

2. The image processor according to claim 1, wherein the combined image includes a mirrored image of the target.

3. The image processor according to claim 1, wherein the output is operable to output the signal representing the combined image to a predetermined display device.

4. The image processor according to claim 1, wherein the target is a first target, the captured series of images includes a plurality of targets including the first target each being subject to move within the captured series of images from one point in the time to another point in the time, and the detector is operable to detect the quantitative value of the movement component of each of the plurality of targets and to detect a particular one of the plurality of targets based on the detected quantitative values of the movement components of the plurality of targets such that the image generator is operable to change the color of the object image according to the detected quantitative value of the movement component of the particular target.

5. The image processor according to claim 1, wherein the object image is associated with predetermined processing and the image generator is further operable to perform the predetermined processing when the detected quantitative value of the movement component satisfies a predetermined condition.

6. The image processor according to claim 1, wherein the detected quantitative value of the movement component includes a rate of movement of the target.

7. The image processor according to claim 1, wherein the detected quantitative value of the movement component includes a cumulative amount of movement of the target.

8. The image processor as claimed in claim 7, wherein the image generator is operable to generate the object image so that the object image changes when the detected cumulative amount of movement of the target exceeds a threshold.

9. An image processing method, comprising:

storing in real time a series of images of a location captured by an imaging device over time, the captured series of images at least partially including a target that is subject to move within the captured series of images from one point in the time to another point in the time;

detecting the target and a quantitative value of a movement component thereof by detecting differences between features of the captured series of images at a first point in the time and at a second point in the time;

generating an object image representing a predetermined object so that a color of a predetermined portion of the object image varies according to the detected quantitative value of the movement component of the target;

generating a combined image from the object image and an image from the captured series of images; and

outputting in real time a signal representing the combined image at the location captured in the series of images to display the combined image at the location.

10. A computer-readable recording medium having instructions recorded thereon, the instructions being executable by a computer or image processing system to perform a method, the method comprising:

storing in real time a series of images of a location captured by an imaging device over time, the captured series of images at least partially including a target that is subject to move within the captured series of images from one point in the time to another point in the time;

detecting the target and a quantitative value of a movement component thereof by detecting differences between features of the captured series of images at a first point in the time and at a second point in the time;

generating an object image representing a predetermined object so that a color of a predetermined portion of the object image varies according to the detected quantitative value of the movement component of the target;

generating a combined image from the object image and an image from the captured series of images; and

outputting in real time a signal representing the combined image at the location captured in the series of images.

11. A system operable to process an image, comprising:

a one or more semiconductor devices, the one or more semiconductor devices including;

(a) a memory operable to store in real time a series of images of a location captured by an imaging device over time, the captured series of images at least partially including a target that is subject to move within the captured series of images from one point in the time to another point in the time,

(b) a detector operable to detect the target and a quantitative value of a movement component thereof by detecting differences between features of the captured series of images at a first point in the time and at a second point in the time,

(c) an image generator operable to generate an object image representing a predetermined object so that a color of a predetermined portion of the object image varies according to the detected quantitative value of the movement component of the target, the image generator being further operable to generate a combined image from the object image and an image from the captured series of images, and

(d) an output operable to output in real time a signal representing the combined image at the location captured in the series of images.