Image processor, image processing method, recording medium, computer program and semiconductor device

• US 20070013718A1
• Filed: 09/18/2006
• Published: 01/18/2007
• Est. Priority Date: 10/06/2000
• Status: Abandoned Application

• Current Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Ohba, Akio
• Application Number:
  US11/522,775
• Publication Number:
  US 20070013718A1
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

An image processor is provided which utilizes images taken by an imaging device, e.g., a digital camera, as an input interface to enter commands, etc. A memory is operable to store in real time a series of images of a location captured by the imaging device over time. A detector detects a target captured in the series of images and a quantitative value of a movement component of the target by detecting differences between features of the captured series of images between points in time. An image generator is operable to generate an object image, the object image following a movement of the detected target and including an image representing a trace of the movement. An image generator generates a combined image from the object image and an image from the captured series of images. An output is operable to output in real time a signal representing the combined image at the location captured in the series of images.

Claims

1. An image processor, comprising:

a memory operable to store in real time a series of images of a location captured by an imaging device over time, the captured series of images at least partially including a target that is subject to move within the captured series of images from one point in the time to another point in the time;

a detector operable to detect the target and a quantitative value of a movement component thereof by detecting differences between features of the captured series of images at a first point in the time and at a second point in the time;

an image generator operable to generate an object image representing a predetermined object so that the object image follows a movement of the detected target and includes an image representing a trace of the movement, the image generator being further operable to generate a combined image from the object image and an image from the captured series of images; and

an output operable to output in real time a signal representing the combined image at the location captured in the series of images.

2. The image processor according to claim 1, wherein the combined image includes a mirrored image of the target.

3. The image processor according to claim 1, wherein the output is operable to output the signal representing the combined image to a predetermined display device.

4. The image processor according to claim 1, wherein the target is a first target, the captured series of images at least partially includes a plurality of targets including the first target, each of the plurality of targets being subject to move within the captured series of images from one point in the time to another point in the time, and the detector is operable to detect the quantitative value of the movement component of each of the plurality of targets and to detect a particular one of the plurality of targets based on the detected quantitative values of the movement components of the plurality of targets such that the object image follows the movement of the particular target, and the image representing the trace of the movement represents the trace of the movement of the particular target.

5. The image processor according to claim 1, wherein the object image is associated with predetermined processing and the image generator is further operable to perform the predetermined processing when the detected quantitative value of the movement component satisfies a predetermined condition.

6. The image processor according to claim 1, wherein the detected quantitative value of the movement component includes a rate of movement of the target.

7. The image processor according to claim 1, wherein the detected quantitative value of the movement component includes a cumulative amount of movement of the target.

8. An image processing method, comprising:

storing in real time a series of images of a location captured by an imaging device over time, the captured series of images at least partially including a target that is subject to move within the captured series of images from one point in the time to another point in the time;

detecting the target and a quantitative value of a movement component thereof by detecting differences between features of the captured series of images at a first point in the time and at a second point in the time;

generating an object image representing a predetermined object so that the object image follows a movement of the detected target and includes an image representing a trace of the movement;

generating a combined image from the object image and an image from the captured series of images; and

outputting in real time a signal representing the combined image at the location captured in the series of images.

9. A computer-readable recording medium having instructions recorded thereon, the instructions being executable by a computer or image processing system to perform a method, the method comprising:

storing in real time a series of images of a location captured by an imaging device over time, the captured series of images at least partially including a target that is subject to move within the captured series of images from one point in the time to another point in the time;

detecting the target and a quantitative value of a movement component thereof by detecting differences between features of the captured series of images at a first point in the time and at a second point in the time;

generating an object image representing a predetermined object so that the object image follows a movement of the detected target and includes an image representing a trace of the movement;

generating a combined image from the object image and an image from the captured series of images; and

outputting in real time a signal representing the combined image at the location captured in the series of images.

10. A system operable to process an image, comprising:

one or more semiconductor devices, the one or more semiconductor devices including;

a memory operable to store in real time a series of images of a location captured by an imaging device over time, the captured series of images at least partially including a target that is subject to move within the captured series of images from one point in the time to another point in the time,

a detector operable to detect the target and a quantitative value of a movement component thereof by detecting differences between features of the captured series of images at a first point in the time and at a second point in the time,

an image generator operable to generate an object image representing a predetermined object so that the object image follows a movement of the detected target and includes an image representing a trace of the movement, the image generator being further operable to generate a combined image from the object image and an image from the captured series of images, and

an output operable to output in real time a signal representing the combined image at the location captured in the series of images.