Image processing apparatus and image processing method for indicating movement information

• US 8,588,475 B2
• Filed: 12/01/2011
• Issued: 11/19/2013
• Est. Priority Date: 12/09/2010
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Takagi, Yoshinori
• Primary Examiner(s): Bhatnagar, Anand
• Assistant Examiner(s): BEG, SAMAH A
• Application Number:
  US13/308,657
• Publication Number:
  US 20120148107A1
• Time in Patent Office: 719 Days
• Field of Search: None
• US Class Current: 382/107
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/91 Television signal processing therefor
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

An image processing apparatus including: a representative image creating section which creates a representative image on the basis of images of respective screens which form a predetermined scene; and a symbol drawing section which draws, on the basis of a movement of a target portion of each screen in the predetermined scene, a symbol indicating the movement of the target portion in a peripheral section of the representative image created by the representative image creating section.

Claims

1. An image processing apparatus comprising:

one or more processors operable to;

create a representative image based on images of respective screens which form a predetermined scene;

draw a symbol based on a movement of a target portion of each of the respective screens in the predetermined scene,

wherein the symbol is drawn in a peripheral section of the representative image indicating the movement of the target portion; and

calculate a staying number of the target portion of each of the respective screens based on the movement of the target portion of each of the respective screens in the predetermined scene,

wherein when it is determined that the target portion of a corresponding one of the respective screens is staying, the one or more processors are operable to set the staying number of the target portion of the corresponding one of the respective screens to 0 and increment a staying counter by 1, and when it is determined that the target portion of the corresponding one of the respective screens is not staying, the one or more processors are operable to set the staying number of the target portion of an immediately previous screen to a value of the staying counter, set the staying number of the target portion of the corresponding one of the respective screens to 1, set the value of the staying counter to 1, and set a staying number of the target portion of a final screen of the respective screens to the value of the staying counter, and

wherein the symbol indicating the movement of the target portion in the peripheral section of the representative image is drawn based on the staying number of the target portion of each of the respective screens.

2. The image processing apparatus according to claim 1,

wherein the symbol is drawn in the peripheral section of the representative image in the position corresponding to the target portion of the predetermined screen when the staying number of the target portion of the predetermined screen is 1 or more.

3. The image processing apparatus according to claim 2,

wherein the drawn symbol is a normal symbol in the position corresponding to the target portion of the predetermined screen in the peripheral section of the representative image when the staying number of the target portion of the predetermined screen is 1 or more and N or less,

wherein N is an integer which is equal to or larger than 1;

and

wherein the drawn symbol is a staying symbol in the position corresponding to the target portion of the predetermined screen in the peripheral section of the representative image when the staying number of the target portion of the predetermined screen exceeds N.

4. The image processing apparatus according to claim 3,

wherein the drawn symbol is of a line segment shape extending in a direction perpendicular to a movement direction of the target portion;

and

wherein a length of the normal symbol is set corresponding to a magnitude of the movement of the target portion of the predetermined screen when the staying number of the target portion of the predetermined screen is N or less.

5. The image processing apparatus according to claim 4,

wherein the length h of the normal symbol drawn when the staying number of the target portion of the predetermined screen is 1 or more and N or less, is set according to an expression H*Mv/Mvmax, where H is the length, in the direction perpendicular to the movement direction of the target portion, Mvmax is a maximum movement among the movements of the target portion, and Mv is the movement of the target portion of each of the respective screens.

6. The image processing apparatus according to claim 3,

wherein the one or more processors are operable to determine a proximity between the drawn symbols, and change a drawing state of the normal symbol when the staying number of the target portion of the predetermined screen is 1 or more and N or less based on the determination result.

7. The image processing apparatus according to claim 6,

wherein the one or more processors are operable to draw the normal symbol every predetermined number of screens of the respective screens so that the distance between the drawn symbols in the movement direction of the target portion exceeds a predetermined value in a display region of an output device.

8. The image processing apparatus according to claim 7,

wherein the one or more processors are operable to:

draw, as the symbol, a symbol of a line segment shape extending in a direction perpendicular to a movement direction of the target portion;

calculate a length h of the normal symbol drawn when the staying number of the target portion of the predetermined screen is 1 or more and N or less according to an expression H*Mv/Mvmax where H is the length, in the direction perpendicular to the movement direction of the target portion, Mvmax is a maximum movement among the movements of the target portion, and Mv is the movement of the target portion of each of the respective screens; and

draw the normal symbol drawn in every predetermined number of screens deeply and draws the normal symbol in a different screen lightly.

9. The image processing apparatus according to claim 6,

wherein when the distance between the drawn symbols in the movement direction of the target portion is smaller than a predetermined value in a display region of an output device, an acceleration symbol is drawn corresponding to an acceleration period, a constant velocity symbol is drawn corresponding to a constant velocity period, and a deceleration symbol is drawn corresponding to a deceleration period, according to a movement difference of the target portion between each of the respective screens and a previous screen.

10. The image processing apparatus according to claim 9, wherein the one or more processors are further operable to:

calculate a constant velocity number of each of the respective screens based on the movement difference of the target portion between each of the respective screens and a previous screen in the predetermined scene,

wherein when it is determined that the target portion of the predetermined screen is staying, the constant velocity number of the target portion of the predetermined screen is set to 0 and a constant velocity counter is incremented by 1, and when it is determined that the target portion of the predetermined-screen is not staying, the constant velocity number of the target portion of an immediately previous screen is set to a value of the constant velocity counter, the constant velocity number of the target portion of the predetermined screen is set to 1, and the value of the constant velocity counter is set to 1, and

wherein the acceleration symbol or the deceleration symbol is displayed in the peripheral section of the representative image in the position corresponding to the target portion of the predetermined screen when the constant velocity number of the target portion of the predetermined screen is 1 or more and M or less,

wherein M is an integer which is equal to or larger than 1, and

wherein the constant velocity symbol is drawn in the peripheral section of the representative image corresponding to the target portion of the predetermined screen when the constant velocity number of the target portion of the predetermined screen exceeds M.

11. The image processing apparatus according to claim 10,

wherein the one or more processors are operable to accumulates the movement difference of each of the target portion of the respective screens, and

determine whether the target portion of the predetermined screen moves at a constant velocity according to whether the accumulated value is within the range of a threshold, and sets the accumulated value to 0 if it is determined that the target portion of the predetermined screen moves at the constant velocity.

12. The image processing apparatus according to claim 10,

wherein the one or more processors determines whether the target portion of the corresponding one of the respective screens moves at a constant velocity according to whether the movement difference of the target portion of the predetermined screen is within the range of a threshold.

13. The image processing apparatus according to claim 6,

wherein the one or more processors calculates a distance d between the closest symbols in a display region according to an expression W*Vmin/S, where the length of one screen in a movement direction of the target portion is S, a minimum movement among the movements of the target portion, in which it is determined that the target portion is not staying, is Vmin, and the length in the movement direction of the target portion of a display region of the representative image in an output device is W, and determines the proximity between the symbols based on the distance d.

14. An image processing method comprising:

in an image processing apparatus comprising one or more processors;

creating a representative image based on images of respective screens which form a predetermined scene;

drawing a symbol based on a movement of a target portion of each of the respective screens in the predetermined scene,

wherein the symbol is drawn in a peripheral section of the representative image indicating the movement of the target portion; and

calculating a staying number of the target portion of each of the respective screens based on the movement of the target portion of each of the respective screens in the predetermined scene,

wherein when it is determined that the target portion of a corresponding one of the respective screens is staying, the staying number of the target portion of the corresponding one of the respective screens is set to 0 and a staying counter is incremented by 1, and when it is determined that the target portion of the corresponding one of the respective screens is not staying, the staying number of the target portion of an immediately previous screen is set to a value of the staying counter, the staying number of the target portion of the corresponding one of the respective screens is set to 1, the value of the staying counter is set to 1, and a staying number of the target portion of a final screen of the respective screens is set to the value of the staying counter, and

wherein the symbol indicating the movement of the target portion in the peripheral section of the representative image is drawn based on the staying number of the target portion of each of the respective screens.

15. An image processing apparatus comprising:

one or more processors operable to;

create a representative image, wherein the representative image is a united image obtained by connecting images of respective screens which form a predetermined scene;

draw a first symbol based on an entire screen movement of each of the respective screens in the predetermined scene,

wherein the first symbol is drawn in a peripheral section of the representative image in a first position indicating the entire screen movement;

draw a second symbol based on a movement of a target portion of each of the respective screens in the predetermined scene,

wherein the second symbol is drawn in the peripheral section of the representative image indicating the movement of the target portion; and

calculate a staying number of the target portion of each of the respective screens based on the movement of the target portion of each of the respective screens in the predetermined scene,

wherein when it is determined that the target portion of a corresponding one of the respective screens is staying, the one or more processors are operable to set the staying number of the target portion of the corresponding one of the respective screens to 0 and increment a staying counter by 1, and when it is determined that the target portion of the corresponding one of the respective screens is not staying, the one or more processors are operable to set the staying number of the target portion of an immediately previous screen to a value of the staying counter, set the staying number of the target portion of the corresponding one of the respective screens to 1, set the value of the staying counter to 1, and set a staying number of the target portion of a final screen of the respective screens to the value of the staying counter, and

wherein the second symbol indicating the movement of the target portion in the peripheral section of the representative image is drawn based on the staying number of the target portion of each of the respective screens.