Image processor, image processing method, recording medium, computer program and semiconductor device

• US 20040233224A1
• Filed: 06/21/2004
• Published: 11/25/2004
• Est. Priority Date: 10/06/2000
• Status: Active Grant

• Current Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Akio Ohba
• Inventors: Ohba, Akio
• Granted Patent: US 7,176,945 B2
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

An image processor is provided which utilizes images taken by an imaging device, e.g., a digital camera, as an input interface to enter commands, etc. Such image processor includes a memory operable to store an image from a series of real time images of a location captured by an imaging device over time, the stored image at least partially including a target that is subject to movement from one point in the time to another point in the time. The image processor further includes a detector operable to detect the target and a movement component thereof by detecting features of the captured images at different points in the time, and includes an image generator operable to generate an object image representing a predetermined object so that a color of a predetermined portion of the object image varies according to the detected movement component of the target. Such image generator is further operable to generate a combined image from the object image and the stored image and to output in real time a signal representing the combined image, to permit the combined image to be displayed to the location imaged by the imaging device.

Claims

1. An image processor, comprising:

a memory operable to store an image from a series of real time images of a location captured by an imaging device over time, the stored image at least partially including a target that is subject to movement from one point in the time to another point in the time;

a detector operable to detect the target and a movement component thereof by detecting features of the captured images at different points in the time; and

an image generator operable to generate an object image representing a predetermined object so that a color of a predetermined portion of the object image varies according to the detected movement component of the target, the image generator being further operable to generate a combined image from the object image and the stored image and to output in real time a signal representing the combined image, to permit the combined image to be displayed to the location imaged by the imaging device.

2. The image processor according to claim 1, wherein the combined image includes a mirrored image of the target.

3. The image processor according to claim 1, wherein the image generator is operable to output the signal representing the combined image to a predetermined display device, to permit the combined image to be displayed to the location imaged by the imaging device.

4. The image processor according to claim 1, wherein the stored image includes a plurality of targets that are subject to movement from one point in the time to another point in the time, and the detector is operable to detect the movement component of each of the plurality of targets and to detect a particular target based on the detected movement components of the plurality of targets, and the image generator is operable to change the color of the object image according to the detected movement component of the detected particular target.

5. The image processor according to claim 1, wherein the object image is associated with predetermined processing and the image generator is further operable to perform the predetermined processing when the detected movement component satisfies a predetermined condition.

6. The image processor according to claim 1, wherein the detected movement component includes a rate of movement of the target.

7. The image processor according to claim 1, wherein the detected movement component includes a cumulative amount of movement of the target.

8. An image processor, comprising:

a memory operable to store an image from a series of real time images of a location captured by an imaging device over time, the stored image at least partially including a target that is subject to movement from one point in the time to another point in the time;

a detector operable to detect the target and a movement component thereof by detecting features of the captured images at different points in the time; and

an image generator operable to generate an object image representing a predetermined object so that the object image follows a movement of the detected target and includes an image representing a trace of the movement, the image generator being further operable to generate a combined image from the object image and the stored image and to output in real time a signal representing the combined image, to permit the combined image to be displayed to the location imaged by the imaging device.

9. The image processor according to claim 8, wherein the combined image includes a mirrored image of the target.

10. The image processor according to claim 8, wherein the image generator is operable to output the signal representing the combined image to a predetermined display device, to permit the combined image to be displayed to the location imaged by the imaging device.

11. The image processor according to claim 8, wherein the stored image includes a plurality of targets that are subject to movement from one point in the time to another point in the time, and the detector is operable to detect the movement component of each of the plurality of targets and to detect a particular target based on the detected movement components of the plurality of targets, and the object image follows the movement of the detected particular target, such that the image representing the trace of the movement represents that of the detected particular target.

12. The image processor according to claim 8, wherein the object image is associated with predetermined processing and the image generator is further operable to perform the predetermined processing when the detected movement component satisfies a predetermined condition.

13. The image processor according to claim 8, wherein the detected movement component includes a rate of movement of the target.

14. The image processor according to claim 8, wherein the detected movement component includes a cumulative amount of movement of the target.

15. An image processing method, comprising:

storing an image from a series of real time images of a location captured by an imaging device over time, the stored image at least partially including a target that is subject to movement from one point in the time to another point in the time;

detecting the target and a movement component thereof by detecting features of the captured images at different points in the time;

generating an object image representing a predetermined object so that a color of a predetermined portion of the object image varies according to the detected movement component of the target;

generating a combined image from the object image and the stored image; and

outputting in real time a signal representing the combined image, to permit the combined image to be displayed to the location imaged by the imaging device.

16. An image processing method, comprising:

storing an image from a series of real time images of a location captured by an imaging device over time, the stored image at least partially including a target that is subject to movement from one point in the time to another point in the time;

detecting the target and a movement component thereof by detecting features of the captured images at different points in the time;

generating an object image representing a predetermined object so that the object image follows a movement of the detected target and includes an image representing a trace of the movement;

generating a combined image from the object image and the captured image; and

outputting in real time a signal representing the combined image, to permit the combined image to be displayed to the location imaged by the imaging device.

17. A machine-readable recording medium having instructions recorded thereon for performing a method, the method comprising:

storing an image from a series of real time images of a location captured by an imaging device over time, the stored image at least partially including a target that is subject to movement from one point in the time to another point in the time;

detecting the target and a movement component thereof by detecting features of the captured images at different points in the time;

generating an object image representing a predetermined object so that a color of a predetermined portion of the object image varies according to the detected movement component of the target;

generating a combined image from the object image and the stored image; and

outputting in real time a signal representing the combined image, to permit the combined image to be displayed to the location imaged by the imaging device.

18. A machine-readable recording medium having instructions recorded thereon for performing a method, the method comprising:

storing an image from a series of real time images of a location captured by an imaging device over time, the stored image at least partially including a target that is subject to movement from one point in the time to another point in the time;

detecting the target and a movement component thereof by detecting features of the captured images at different points in the time;

generating an object image representing a predetermined object so that the object image follows a movement of the detected target and includes an image representing a trace of the movement;

generating a combined image from the object image and the captured image; and

outputting in real time a signal representing the combined image, to permit the combined image to be displayed to the location imaged by the imaging device.

19. A semiconductor device for causing a computer to perform functions, the functions comprising:

storing an image from a series of real time images of a location captured by an imaging device over time, the stored image at least partially including a target that is subject to movement from one point in the time to another point in the time;

detecting the target and a movement component thereof by detecting features of the captured images at different points in the time;

generating an object image representing a predetermined object so that a color of a predetermined portion of the object image varies according to the detected movement component of the target;

generating a combined image from the object image and the stored image; and

outputting in real time a signal representing the combined image, to permit the combined image to be displayed to the location imaged by the imaging device.

20. A semiconductor device for causing a computer to perform functions, the functions comprising:

storing an image from a series of real time images of a location captured by an imaging device over time, the stored image at least partially including a target that is subject to movement from one point in the time to another point in the time;

detecting the target and a movement component thereof by detecting features of the captured images at different points in the time;

generating an object image representing a predetermined object so that the object image follows a movement of the detected target and includes an image representing a trace of the movement;

generating a combined image from the object image and the captured image; and

outputting in real time a signal representing the combined image, to permit the combined image to be displayed to the location imaged by the imaging device.