Image processing apparatus to transmit moving image data

• US 8,488,017 B2
• Filed: 07/29/2011
• Issued: 07/16/2013
• Est. Priority Date: 11/06/2007
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Niida, Mitsuo
• Primary Examiner(s): SPINKS, ANTOINETTE T
• Application Number:
  US13/193,909
• Publication Number:
  US 20110279728A1
• Time in Patent Office: 718 Days
• Field of Search: 348/222.1, 348/231.2, 348/231.3, 386/241, 386/246
• US Class Current: 348/222.1
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

An image processing apparatus includes a moving image generating unit, an instruction unit, a control unit, an additional information generating unit, a multiplexing unit, and a transmitting unit. The control unit controls the moving image generating unit in accordance with a frame rate changing instruction provided by the instruction unit such that the frame rate of moving image data generated by the moving image generating unit is changed from a first frame rate to a second frame rate. The additional information generating unit generates additional information indicating a particular period. The multiplexing unit adds the additional information to the moving image data and the transmitting unit transmits the moving image data and the additional information output from the multiplexing unit.

Claims

1. An image processing apparatus, comprising:

a moving image generating unit configured to generate moving image data;

an instruction unit configured to provide a frame rate changing instruction to change a frame rate of the moving image data;

a control unit configured to control the moving image generating unit in accordance with the frame rate changing instruction provided by the instruction unit such that the frame rate of the moving image data generated by the moving image generating unit is changed from a first frame rate to a second frame rate;

an additional information generating unit configured to generate additional information indicating a period from a frame of the moving image data of the first frame rate to a frame rate changing point at which the frame rate of the moving image data generated by the moving image generating unit is changed from the first frame rate to the second frame rate in accordance with the frame rate changing instruction provided by the instruction unit;

a multiplexing unit configured to add the additional information to the moving image data of the first frame rate generated by the moving image generating unit,

wherein the multiplexing unit starts to add the additional information to each frame of the moving image data of the first frame rate from a predetermined period before the frame rate changing point,

wherein a value of the additional information added to the moving image data of the first frame rate is decremented by one at every frame; and

a transmitting unit configured to transmit the moving image data and the additional information output from the multiplexing unit.

2. The image processing apparatus according to claim 1, wherein the additional information generating unit starts to generate the additional information from n frames before the frame rate changing point, wherein n is an integer having a value greater than or equal to one, and wherein the multiplexing unit starts to add the additional information to the moving image data of the first frame rate from the n frame before the frame rate changing point.

3. An image processing apparatus, comprising:

an obtaining unit configured to obtain moving image data, a frame rate of the moving image data changing from a first frame rate to a second frame rate;

a generating unit configured to generate additional information indicating the second frame rate;

a multiplexing unit configured to add the additional information generated by the generating unit to the moving image data of the first frame rate,

wherein the multiplexing unit adds the additional information to a plurality of frames of a predetermined period immediately before a frame rate changing point at which the frame rate of the moving image data is changed from the first frame rate to the second frame rate; and

an output unit configured to output the moving image data and the additional information output from the multiplexing unit.

4. The image processing apparatus according to claim 3, wherein the multiplexing unit adds the additional information to n frames immediately before the frame rate changing point, wherein n is an integer having a value greater than or equal to one, and wherein the multiplexing unit determines the value of n based on a value of the first frame rate.

5. An image processing apparatus, comprising:

an obtaining unit configured to obtain moving image data, a frame rate of the moving image data changing from a first frame rate to a second frame rate;

a generating unit configured to generate additional information relating to a period from a frame of the moving image data of the first frame rate to a frame rate changing point at which the frame rate of the moving image data generated by the moving image generating unit is changed from the first frame rate to the second frame rate;

a multiplexing unit configured to add the additional information generated by the generating unit to the moving image data of the first frame rate,

wherein the multiplexing unit adds the additional information to a plurality of frames of a predetermined period immediately before the frame rate changing point; and

an output unit configured to output the moving image data and the additional information output from the multiplexing unit.

6. The image processing apparatus according to claim 5, wherein the generating unit generates the additional information indicating a number of frames from each of the plurality of frames of the predetermined period to the frame rate changing point, and

wherein the multiplexing unit adds the additional information to each of the plurality of frames of the predetermined period.

7. A method for an image processing apparatus, the method comprising:

generating moving image data;

providing a frame rate changing instruction to change a frame rate of the moving image data;

controlling the generating in accordance with the provided frame rate changing instruction such that the frame rate of the generated moving image data is changed from a first frame rate to a second frame rate;

generating additional information indicating a period from a frame of the moving image data of the first frame rate to a frame rate changing point at which the frame rate of the generated moving image data is changed from the first frame rate to the second frame rate in accordance with the provided frame rate changing instruction;

adding, in an adding step, the additional information to the moving image data of the generated first frame rate,

wherein the adding step starts to add the additional information to each frame of the moving image data of the first frame rate from a predetermined period before the frame rate changing point,

wherein a value of the additional information added to the moving image data of the first frame rate is decremented by one at every frame; and

transmitting the moving image data and the additional information output from the adding step.

8. A method for an image processing apparatus, the method comprising:

obtaining moving image data, a frame rate of the moving image data changing from a first frame rate to a second frame rate;

generating additional information relating to a period from a frame of the moving image data of the first frame rate to a frame rate changing point at which the frame rate of the generated moving image data is changed from the first frame rate to the second frame rate;

adding, in an adding step, the generated additional information to the moving image data of the first frame rate,

wherein the adding step adds the additional information to a plurality of frames of a predetermined period immediately before the frame rate changing point; and

outputting the moving image data and the additional information output from the adding step.

9. A method for an image processing apparatus, the method comprising:

obtaining moving image data, a frame rate of the moving image data changing from a first frame rate to a second frame rate;

generating additional information indicating the second frame rate;

adding, in an adding step, the additional information generated by a generating unit to the moving image data of the first frame rate,

wherein the adding step adds the additional information to a plurality of frames of a predetermined period immediately before a frame rate changing point at which the frame rate of the moving image data is changed from the first frame rate to the second frame rate; and

outputting the moving image data and the additional information output from the adding step.